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1 Review of the results 



1.1 Introduction 

Let (M, g) be a locally symmetric even-dimensional Riemannian manifold with negative 
sectional curvature. Its universal covering X — ;> M is a Riemannian symmetric space 
of rank one. The group of orientation preserving isometrics G' of X is a connected 
semisimple Lie group of real rank one. Then X = G'/K', where K' is the maximal 
compact subgroup of G'. The fundamental group of M acts by covering transformations 
on X and gives rise to a discrete, co-compact subgroup F C G' such that M := F\G'/K'. 
Let G be a linear connected finite covering of G' such that the embedding F '=^ G' lifts 
to an embedding F =^ G and let K be the maximal compact subgroup of G. Then 
X = G/K and M = F\G/K. Let g = k © p be the Cartan decomposition of g and a be 
a maximal abelian subspace in p. Let M = Ga fl K be the centralizer of a in K and M 
be the unitary dual. To M and the M-type a G M we associate a theta function 6{t, a) 
and a Selberg zeta function Zs{p, cr). Both will be meromorphic functions on the complex 
plane. 
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The ^-function is defined using the spectral data of elliptic operators over M. The sin- 
gularities of the theta function contain geometric information about the closed geodesies 
of M and their lifts to the locally homogeneous bundle G Xm K- over the unit sphere 
bundle of M. 

The Selberg zeta function is, in some sense, the dual object to the theta function. It 
is defined, using the geometric data provided by the closed geodesies of M. This data 
appears as certain residues of the corresponding theta function. The singularities of the 
Selberg zeta function, in turn, contain the spectral data employed in the definition of the 
theta function. 

The theta function and the Selberg zeta function satisfy functional equations. The 
functional equation of the theta function connects the theta function of M with an anal- 
ogous function which is associated to the compact dual symmetric space. 

The right hand side of the functional equation of the Selberg zeta function involves 
Plancherel measures. One of the main ideas of the present paper is to relate these 
Plancherel measures to the harmonic analysis over the compact dual symmetric space. 

Let G'' C G'^ be the compact dual group of G, where G'^ is the complexification of 
G. Then the compact dual symmetric space is Xd '■= G'^/K. 

The Selberg zeta function Zs{p, <j) associated to the M-type a G M is usually defined 
by an infinite product converging on some half plan Re{p) > p. The problem is to find 
an analytic continuation and to explain the singularities (zeros and poles). 



The Selberg zeta functions were first introduced by Selberg ||3^. Gangolli |jTj] gave a 



definition in the spherical case, i.e. for the trivial M-type. Fried |10| defined Selberg zeta 
functions for general a G M in the rank one case. 

Gangolli applies the Selberg trace formula in order to obtain the meromorphic exten- 
sion of the zeta function, the functional equation and an explanation of its singularities. 

Fried employs the connection of Selberg zeta functions with the Ruelle zeta function 
in order to give an alternative proof of the meromorphic extension based on dynami- 
cal systems. He announced a detailed investigation of the Selberg zeta function in ]TT| 
(unpublished). 



The Selberg zeta functions appearing in the work of Wakayama [^ are associated 
to K-types 7 G K. Using the Selberg trace formula Wakayama provides a meromorphic 
extension, a functional equation and a description of the singularities. Wakayama's zeta 
function is closely related to the zeta functions Zs{p,<j), where a C 7|m- The fact that 
Wakayama's Selberg zeta functions are associated to K-types causes a rather complicated 
description of their singularities and some of them have no explicit spectral interpretation 
at all. We feel that the Selberg zeta function should naturally be associated to M-types. 



Juhl ||2T[ describes a direct approach to the description of the singularities of the 
Selberg zeta function in terms of n-cohomologies of unitary (g, K)-modules \4 and the 
multiplicities Nr{n). The G-module decomposition L^(r\G) = Z^vtgg ^r(7r)Kr defines 
Nr{n). Juhl employs his dynamical Lefschetz formula. 

The theta function associated to the trivial M-type was first studied by Cartier-Voros 
[H in the case when M is a Riemann surface. For general a G M the theta function 6{t, a) 



was introduced by Juhl |2^. In his definition he employs the data given by a subset of 
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singularities of the corresponding Selberg zeta function. Juhl's proof of the meromorphic 
continuation is based on the functional equation and the Euler product representation for 
the Selberg zeta function (for related results see Cramer and Jorgenson-Lang [ll9| ). 



The present work is a continuation of our previous paper |^. It provides a self con- 
tained approach to the theta functions, Selberg and Ruelle zeta functions. 

We reprove and strengthen results about the Selberg zeta function which are already 
known or at least folklore. Our motivation for writing this paper is to introduce a new 
point of view leading to a better understanding of the zeta functions. 

The point of view in the previous papers dealing with Selberg zeta functions was 



• harmonic analysis on G (Gangolli [|14|, Wakayama ||35|1 ) 

• the geodesic flow as a dynamical system (Fried |T^, Juhl pT|). 

In our approach we try to relate everything to the analysis of elliptic operators on locally 
homogeneous bundles over M. The main tool is the fundamental solution of the wave 
equation which we employ in order to prove a distributional trace formula. The coefficients 
of Hadamard's asymptotic expansion of the local trace of this fundamental solution are 
related to the corresponding coefficients of the asymptotic expansion of the local trace 
of the fundamental solution of the wave equation on the compact dual space. Taking 
the spectral analysis on the compact dual space as input we derive the trace formula 
without using any harmonic analysis over the non-compact symmetric space. Once having 
established a suitable trace formula, our techniques to derive the properties of the theta 
functions are the same as in |^. 

As in the standard approach we relate the logarithmic derivative of Selberg zeta 
function to the product of resolvents. Instead of regularizing by considering a suitable 
derivative of this logarithmic derivative we apply our \l/-construction (|^, compare with 
Parnovskij p4|). Thus, we don't have problems with the integration constants. Since 
we can relate the singularities of the logarithmic derivative of the Selberg zeta function 
to eigenspaces of operators on M and X^ we can easily conclude that all its residues are 
integers. This resolves the problem that previously in the bundle case one only was able to 
prove (using harmonic analysis) that the residues are rational. This would lead the mero- 
morphicity of a certain power of the Selberg zeta function. Of course, in the work of Fried 
the meromorphicity of the Selberg zeta function was established. But Fried's approach 
does not provide a functional equation and a nice interpretation of the singularities. 

An alternative description of the residues of the logarithmic derivative of the Selberg 
zeta function in terms of data associated to the geodesic flow was given by Juhl [pl|] . 

The Ruelle zeta function can be expressed in terms of Selberg zeta functions as it was 



observed by Fried [0. Thus, in principle, the singularities of the Ruelle zeta function can 
be expressed in terms of the singularities of the corresponding Selberg zeta functions and 
eventually in terms of eigenvalues of operators on bundles over M and X^. In order to 
carry out this program one has to understand quite explicitly how the representations in 
K, which are connected to differential forms, split when restricted to M. A flnal answer 
we only obtained in the case of real and complex hyperbolic manifolds M. 
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Nevertheless, using a trick, we derive a functional equation for the Ruelle zeta function. 
This functional equation was previously obtained by Juhl up to an exponential polynomial, 
which turns out be trivial. The functional equation implies the result of Juhl that the 
order of the singularity of the Ruelle zeta function at s = is 1 / 2dim{M)x{M) (compare 



also Seifarth 30 



Recall that we want to associate the theta and the zeta functions to irreducible rep- 
resentations 0" G M. Moreover we want to find elliptic operators over M which provide 
the related spectral information. 

There is no immediate way to associate a bundle to M-types a carrying the interesting 
elliptic operators. 

A bundle ^(7) = G Xk V^7 can be associated to a K-type 7 G K. Let -R(K) be the 
representation ring of K with integer coefficients. Then, more general, a Z2-graded bundle 
^(7) can be associated to 7 G -R(K) in the obvious way. 

Let r : -R(K) -^ R{M) be the restriction. We show that r is surjective (note that we 
require dim{M) even). Fix a G M. We introduce the subset of r~^(cr) of a-admissible 
7 G R(K). Next we explain this notion of cr-admissibility. 

To 7 G -R(K) we associate a bundle Vd(7) := C^ Xk V^ over Xa- We introduce a 



constant c{a) in Definition pl2|and the operator ^^(7,0") := jQd{l) + c{a), where ^^(7) 
is the Casimir of G'' acting on sections of Vd{'~f). A a-admissible 7 will be characterized 
by the property that the spectrum of Ad{'~f, cr) forms the positive part of a certain lattice 
I/((j) C R, L{a) = T(Z + e(cr)), where T G R is the period only depending on Xd and 
e(cr) G {0, 1/2}. Moreover, the multiphcity of the eigenvalue A, denoted by mrf(A,7,(T), is 
given by a polynomial P(A,cr). Note that we understand the spectrum in the weighted 
sense using the Z2-grading of Vd(7,cr). Thus the multiphcities may be negative and 
Ad{'y, 0") may have other eigenvalues not contained in the lattice, but with zero multiplicity. 
The fact that 7 is a-admissible, fixes the weighted multiplicities of the spectrum of 
A-dilyCr) completely. Hence the local (super) trace Kd(t,'y,a) of the distributional kernel 
of cos(tAd(7, cr)) is determined, too. 

On the bundle V{'y) ^ X we define ^(7, a) := J^i^y) — c(cr), where ^^(7) is the 
Casimir of G acting on sections of ^(7). Let K{t,'~f,a) be the local trace of the distri- 
butional kernel of cos{tA{'j,a)). We estabhsh that K{t,'j,a) = (—l)"'/'^Kd{it,'y,a). This 
observation furnishes the bridge between the analysis on X, M and on Xd- 

The meromorphic function K{t, 7, a) can be expressed in terms of Fourier transforms 
of the Plancherel measures associated to X and cr' occurring in 7|m- An inspection of this 
relation shows that the cr-admissibility of 7 G r^^(cr) can be characterized by the fact, that 
the contributions of all discrete series representations of G in L^(X, ^(7)) to K(t,'y,a) 
must cancel out. This provides sometimes an easy way to check the cr-admissibility, 
namely if L'^{X, ^(7)) does not contain any discrete series representation at all. 

In order to derive the properties of the theta and zeta functions associated to a G M 
we use the analysis of the operators A(7,cr), Am(7,ct) and ^4^(7, cr), where AM(7,cr) is 
the square root of ^m{i) — c^cr) taken positive or with positive imaginary part. ^4/(7) is 
the operator on Va/(7) := r\l^(7) induced from ^2(7). The order of the singularities of the 
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Selberg zeta functions are expressed in terms of weighted multiplicities of the eigenvalues 
of these operators. By comparison with the results of Juhl ||2T[ it follows that these 



weighted multiplicities can be written in terms of Euler characteristics of n-cohomologies. 
It would be interesting to see this connection directly. 

1.2 The results 

In this subsection we give the definition of the theta functions and the zeta functions. 
We collect the structural results proved in the course of the paper together in order to 
provide a self contained reference. 

Let M be an even-dimensional compact rank-one locally symmetric space of non- 
compact type. Its universal covering X is a Riemannian symmetric space of negative 
sectional curvature with the group G' of orientation preserving isometrics. Let F C G' 
be isomorphic to the fundamental group of M such that M = r\X. Choose a linear 
connected finite covering G of G' such that the embedding F ^^ G' lifts to an embedding 
F "^-^ G. Let K be the maximal compact subgroup of G and g = k © p be the Cartan 
decomposition of the Lie algebra g of G. Fix a one-dimensional subspace a C p. Let 
M := K n Ga be the centralizer of a in K. Consider an irreducible representation 
(M-type) 0" G M of M. Let R(K),R(M.) be the integer representation rings of K, M 
Choose 7 G -R(K) such that r{'y) = a and 7 is a-admissible , r : -R(K) -^ R(M.) being 
the restriction. The notion of cr-admissibility was extensively discussed at the end of 



Subsection 1.1 



We normalize the invariant scalar product on g such that it induces a metric on a which 
has the following property. Fix if G a with \H\ = 1. Then H 3 t —>■ g exp{tH)J^ G X 
is a unit speed geodesic. The scalar product on g induces an invariant one on m. The 
Lie algebra g splits as n~ © (m © a) © n+ with respect the negative, zero and positive 
eigenvalues of H. Let p = |tr(/7)|n+ G R. Later we will omit the "-|-"-sign at n. Let 
o"(^m) G R be the action on V^ of the Casimir operator of M defined by the invariant 
scalar product on m. Define c{a) := p^ — a{Q-M)- 

Let V{'y) — *> X be the Z2-graded bundle G Xj^V^ and Vm(7) be the push down to M. 
The Casimir operator ^(7) acts as an unbounded selfadjoint operator on L'^{X,V{'y)). 
Define ^(7, a) = J^i'y) — c(cr), where we take the positive root or the root with positive 
imaginary part, respectively. Let A|,/(7, cr) be the push down to M of ^(7, a)^ and define 
the square root AM{'y,cr) as above. Similarly we define ^4^(7, a) := -1/^^(7) + c{a) on 
Vd{l) '■= G'^ Xk ^' -^ Xd, where C^ is the compact dual group of G and X^ is the 
compact dual space of X. X^ can be embedded into a complexification of X. The metric 
on Xd is obtained from the metric on X by analytic continuation to the imaginary space. 
In particular, this fixes the scale of the metric and thus the volume of X^- 

Let mrf(A, 7, a) =: P(A, a) be the multiplicity of the eigenvalue A > of ^^(7, a), i.e. 

mrf(A,7,o-) =TrEA^(^,^){A}, 

where the trace is the supertrace taking the Z2-grading into account. P(A, a) is a poly- 
nomial in A and does not depend on 7 (by the very definition of the a-admissibility 
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of 7). The eigenvalues of ^^(7,0") with non-trivial multiplicity are located in a lat- 
tice L{a) = T(Z + e(o")), where T is chosen maximal (and is independent of a) and 
e{cr) G {0,1/2}. Define Q{X,a) by P(A,cr) = XQ{X,a). It turns out that Q{X,(j) is a 
polynomial. 

We introduce the distributions 

K{t,a) := -(-l)»/2_J_^Q(l,a)in(|a„fe(n/2)|), e(a) = 

For (7 G r 7^ 1 let [gf]*^ be its conjugacy class in G. There is an element ma G [g]^ 
such that m G M and a = exp{l{g)H) with R 9 /(gf) > 0. Define 

C(5f,(T) := 



2det{l - Ad{ma) 



Let n^ig) be the number of classes in Tg/ < g >, where Tg is the centralizer oi g inT and 
< 5^ > is the group generated hj g. By CT we denote the set of conjugacy classes of T. 
For (j) G C^(R) we define the trace class operator 

/•oo 

Km,4,= I (j){t)cos{tAM{i,(y)). 

J oo 



Proposition 1.1 (The distributional trace formula) The distribution 

Cr(R) 9 0^ TtKm,^ 
is given by 

vol{M)K{t, a)+ Y: ^^iS{t - l{g)) + 5{t + l{g))). 

Note that we take the trace in the graded sense. 

Let m(A,7,(T) be the (weighted) multiphcity of the eigenvalue A of yljv/(7,cr)- The 
following Proposition is a consequence of the A-index theorem [4.2|. 



Proposition 1.2 (The well-definedness of r?7,(A, a)) The multiplicitym{X,'~f,a) is in- 
dependent of the choice of the a -admissible 7. 

We will write m{X,cr) := m(A,7,cr). The multiplicities have polynomial growth and the 
theta function 

e{t,a) :=^m(A,(T)e-*^ 
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is well defined as a holomorphic function for Re{t) > 0. Defining the dual theta function 
by 

0<AeL(o-) 

we have in the case e((T) = 

Od{t,a) = -^^^Q{j^,a)ln{\sinh{Tt/2)\) 



and in the case t{a) = 1/2 



Ut.<^) = -Y^Mjt^^)H\i9h{Tt/A)\). 



Theorem 1.3 (The theta function) The theta function 6(t,a) admits a meromorphic 
extension to the whole complex plane. It satisfies the functional equation 

e{t, a) + e{-t, a) = 2vol{M)K{tt, a) = 2^^^ed{it, a), 

where we view K{tt,cr) as a meromorphic function. The singularities of6(t,a) are 
• first order poles at t = ±tl{g), g G CT with residue 

C{g,cx) 



rest=±d(g)0{t) 



irnrig) 



• poles of order n at t = 2Txk/T , k = —1, —2, . . . (at these points the singular part 
coincides with that of2vol{M)K{tt,a) ) and 

• a pole of order n at t = 0. 

Note that 2nk/T, k = —1, —2, . . . are the lengths of the closed geodesies of X^. 

We consider now the Selberg zeta function. It is defined for s > p by the infinite 
product 

CO 

Zsis, a)= n n det (l - e^-P-'^^^<^^S\Ad{ma)^^) a{m] 

lg]ecr,[g]ytl,nr{g)=lk=0 



Theorem 1.4 (The Selberg zeta function) The Selberg zeta function has a mero- 
morphic continuation to the complex plane. The singularities (zeros have positive and 
poles negative order) of Zs{s,a) are 

• at p = ±tX of order m{X, a), where X ^ is an eigenvalue o/ Aj\^(7, a), 
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• at p = of order2m{0,a) if is an eigenvalue o/Am(7,o"), 

• at p = —A, A G T(N + e{cr)) of order —2 ^f^ I maiX, cr) . Then X > is an eigenvalue 
of Adij^a). 

If two such points coincide, then the orders add up. 



Theorem 1.5 (Functional equation) The Selherg zeta function satisfies the functional 
equation 



Zs(-s,u) ' \ x(A'j) r 7o '^•'^'^- ' \ -ctg(T,plT) t(a) = 

Note that the integrand is the Plancherel density (up to a constant factor) of the contri- 
bution to L'^{G) of the principal series associated to a. 

Proposition 1.6 (Representation by regularized determinants) The Selherg zeta 
function has the representation 

Zs{p,a) = Cdet{p' + AM{l,a)'){det{A,{^,a)'-p')r^'^'''^M''^^ (1) 

X{M) TT fP ^, J tg{ns/T) e{a) = 1/2 ^ 



exp 



x{Xa) T L ^^ ' ^ I -ctg{ns/T) e(a) = j ^' ) ' 



The constant C is determined by the condition that Zs{p,cr) should tend to one if p tends 
to infinity on the positive real axis. 

The determinants of the elliptic differential operators are understood in the zeta-regularized 
sense and take the Z2-grading into account. 

The Ruelle zeta function associated to M is defined for Re{s) > 2p by the infinite 
product 

Znis):= n (l-e-'(^))-^ 

lg]ecr,[g]ytl,nr{g)=l 

Using the representation of the Ruelle zeta function in terms of Selberg zeta functions we 
obtain a meromorphic continuation of 2'r(s). In particular we have 

Theorem 1.7 (Functional equation) The Ruelle zeta function satisfies the functional 
equation 

Znis)Zni-s) = s^n(7rs/T)«>^W. 

In particular, the order of the singularity at s = is |x(M) while the order of the 
singularities at s < —2p, s G TZ is nx{M). 

We give a satisfactory spectral interpretation of the singularities of the Ruelle zeta function 
in the case when M is real or complex hyperbolic. In principle, the other cases can be 
solved in a similar way but are still open due to computational difficulties. 
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In the Section ^ we give some more examples for the spectral interpretation of the 
singularities of zeta functions. 

We tried to state our final results in a self-contained form not involving any deep 
machinery but only geometric and spectral data. 

A part of the results of the present paper is "weakly" contained in the previous litera- 
ture. Sometimes it was rather complicated to extract them in a clear way. In many cases 
we were able to improve the published results. 

We hope that our paper not only serves this purpose, but also gives a new approach to 
the topic which is accessible to readers with not much background in harmonic analysis 
and representation theory. Of course, some representation theoretic input is necessary. 
Thus, certain facts about the harmonic analysis on compact symmetric spaces are added 
as a separate section. In particular, the generalization of the Cartan-Helgason theorem 
giving the spectral decomposition of Adi^j, a) seems not to be contained in the published 
literature. 

In forthcoming paper we will discuss the odd- dimensional real hyperbolic case. We 
also plan to study the theta function in the higher rank case. 

We want to thank A. Juhl for his constant interest in this work and for many discus- 
sions. His results and philosophy were helpful for us to find our way through the theory 
developed in the present paper and to check our final results. 



2 Ideal ladders 



2.1 Admissible lifts 



Let R(K), -R(M) denote the representation rings with integer coefficients of the groups 
K, M. The inclusion M C K induces a restriction map r : -R(K) — > i?(M), which is 



surjective by Proposition |9l6| . For any 7 G -R(K) let Vdi'j) — > X^ be the associated Z2- 
graded homogeneous vector bundle. More explicitly, let 7 = Y.\=i h^i with fcj G Z and 
5j G K. Form 

W^:= E il^s^^ (2) 

{i=l : sign{ki)=±l} m=l 

where Ws is the representation space of 5. Then Vdij)'^ is given by ^^(7)^ = G^ Xk W^. 

For any cr G M we define the shift constant c(cr) = |pp + |pmP — \^a + Pml^ (see 

Definition |9.2| for the notation). Let fid (7) be the Casimir operator of G'^ acting on 



sections of the bundle Vd{^)- We define c(cr) and the Casimir operator using an invariant 
scalar product on g'^. The normalization of this scalar product will be fixed later. ^^(7) 
is a positive, selfadjoint operator on L'^{Xd, Vdi^j)) with a discrete spectrum. We consider 



the positive square root Ad{'y,a) := jQ,d{'y) + c{a). Let i?A<i(7,(T)(-) denote the family of 
spectral projections of ^^(7, cr) and define the multiplicity 

md(A,7,cr) ■.= Tr EAa(-y,a)W, 
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where the trace is the super trace with respect to the Z2-grading. Thus, mrf(A,7,o") is a 
weighted dimension of the eigenspace of ^^(7, a) corresponding to the eigenvalue A. 

For the definition of the polynomial P{X, a) and the lattice L{a) we refer to Definition 
|9.2|. From Proposition |9.3| immediately follows 



Corollary 2.1 Let a G M and 7 G -R(K) such thatr{'y) = a. Then md{X, 7, a) = P(A, a) 
for all but finitely many < A G L^a). 

The exceptional set where m(A, 7, a) 7^ -P(A, a) depends on 7. 

Definition 2.2 Let a G M. Then 7 G R{K) is called a-admissible if r(7) = a and 
md{X, 7, cr) = P(A, a) /or all < X e L{a) . 

Thus, for cr-admissible 7 the weighted multiplicities of spectrum of ^^(7, a) have a par- 
ticular nice regularity. In order to construct a-admissible elements 7 we start with some 
7 G -R(K) such that r(7) = a. Then we modify 7 by adding elements in the kernel of 
r. We control the effect of that on the multiplicities using the C^- index theorem. Since 
any representation of G'^ can be realized by the index of homogeneous Dirac operators by 



Theorem p.5| we can modify 7 such md{X, 7, a) changes its value in a given finite number 



of places without changing the multiplicity in the remaining lattice points. 
Corollary 2.3 Let a G M. Then there exist a -admissible 7 G -R(K). 
In fact, there are infinitely many a-admissible 7 G -R(K). 

2.2 The dual theta function 

In the following we will fix a a G M and a a-admissible 7 G i?(K). We simplify our 
notation by omitting a and 7. Thus, md^X) := md{X, 7, a) is independent of the choice of 
the a-admissible 7. 

Definition 2.4 The dual theta function is defined by 

e{ta) = e{t) := Tre-'"^^ = ^mrf(A)e-*^, Re{t) > 0. 

X 

By construction we have 

0<AeL 

From this it can be seen using the Borel-Weil-Bott theorem that our definition of dd 



coincides with that of Juhl 20 



9d{t) is a holomorphic function on the right half plane. We will provide a meromorphic 
extension of 6d to the whole complex plane. Recall the notation L := L{a), P{X) := 
P(A,7,a), the period T of L and e = e(a) G {0,1/2} (Definition |J). Since P(-A) = 
— P(A) we can write P(A) = XQ{X) for some polynomial Q. 
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Lemma 2.5 In the case e = we have 



Od{t) = TQii)- ^ 



A^^dt' sinh'^{tT/2)' 
In the case e = 1/2 we have 

a f+\ ^ n( ^ \ cosh(tT/2) 



A^'-dr sinh'^{tT/2)' 
Proof: Consider the case e = 0. In the half plane Re{t) > we have 

Odit) = E PW^''' 

0<\eL 
°° d d 



A;=0 

-Q(-)-^— 
^^dt'dtl-e-^'^ 



A^^dr sinh'^(tT/2y 
In the case e = 1/2 for Re{t) > we have 



ea{t) = E P(A)e 

0<Ae-L 



-t\ 



d d e-*^/2 

'^^'dt'Jtl-e-''^ 
T d , cosh{tT/2) 



A^^dt' sinh^{tT/2)' 



n 



Corollary 2.6 The dual theta function 6d{t) has a meromorphic continuation to the whole 
complex plane with singularities on the imaginary axis at the points ^Z. 

3 The distributional trace formula 

3.1 The distributions K{t) and Kd{t) 

Let X := G/K be a rank-one symmetric space of non-compact type. We normalize the 
metric of X in the compatible way with the invariant scalar product on g. Let F C G 
be a co-compact, torsion- free discrete subgroup and M := r\X be the compact, locally 
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symmetric space. We fix some a G M and choose some a-admissible 7 G R(K). We 
will again omit a, 7 in our notation. Recall the definition (H) of W^. Let V := V{'y) = 
G Xk (W^ © W~) be the associated Z2-graded homogeneous vector bundle. It induces 
a corresponding bundle Vm over M. Let —Q be the action of the Casimir operator of G 
on V and Qm be push down of fl to Vm- They give rise to selfadjoint operators on the 
Hilbert spaces L'^{X, V) and L'^{M, Vm), respectively. We form the square roots 

Definition 3.1 



A := \ Q — da). Am := \ Qaj — da 



where take the positive root on the positive spectrum and the root with positive imaginary 
part on the negative spectrum. 

For G C^(R) let K^ be the operator 



K^ := f (j)(t)cos(tA)dt. 
Jr 



This operator has a smooth integral kernel. By the G-invariance of A the local (super) 
trace of this kernel is a constant. Choose some x & X. We define the distribution 
K G C^{K)* by 

< K,(j) >:= trK^{x, x), 

where the trace is taken on End{Vx). The definition of K does not depend on x G X. A 
similar distribution Kd can be defined on the compact dual side. Choose some Xd G X^. 
Let Kd,(j) be the operator 

Kd,<f> ■= / (t){t)cos{tAd)dt. 

J Ft 

This operator again has a smooth integral kernel and we define 

< Kd, <p >■= trKd,4,{xd, Xd), 

where the trace is taken on End{Vd^Xd)- -^^^ some a G (0,27r/T). On {—a, a) \ {0} the 
distribution Kd{t) is regular and given by ^voilx^) {(^d{it) + 6d{-it)) = ^oilx'^) ^d{it) because 
of the symmetry of 6d- In particular, Kdit) has a convergent asymptotic expansion 

00 

k=—n 

The numbers hd^k can be obtained from the explicit expression Lemma p.5| . Alternatively, 
the coefficients of the asymptotic expansion can be obtained by Hadamard's analysis. It 
also provides an asymptotic expansion of the distribution K{t) 

00 

k=—n 

Moreover, it gives a detailed information about the distributional nature of the singularity 
of K{t) and Kdif) at t = 0. We can compare hk and hd,k using the fact, that A\ is some 
sort of analytic continuation of A^. 
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3.2 Hadamard's analysis 

We start with recalling the relevant analytical results. For A; > let t'^ be the regular 
distribution on R given by the function T^(t) := t^. Define t~^ by 

r^Vt) := —ln\t\ 
^ ^ dt ^ ^ 



and 



-fc-i ._ _l__-fc 
k dt 



Let G f/ C R" {n even) be an open subset. We consider an even (with respect 
to the Z2-grading) second order differential operator H acting on functions on U with 
values in some Z2-graded vector space W. There are End{Wy'"-valvied functions a^j, Qj, a, 
i,j = l,...,n, such that 

n n 

H := Y^ ttijDiDj + Y^ ajDj + a, 

i,j=l j=l 

where Dj := d/dxK We assume, that H is formally selfadjoint and that its principal 
symbol is positive, i.e. there is a C < cx) such that for all x G t/ and all ^ = (^^, . . . , ^") G 
R" 

n 

Let K{t^ X, y) be the distributional kernel of the solution operator of the Cauchy problem 

(^ + if)/(t,x) = 

/(0,x) = /o(x) (3) 

I f{t,x) = 0. 
att=o 

If /o supported near 0, the solution of problem (Q) exists and is unique for small |t|. 
In some sense, K is the kernel of cos{tH). One can use the Hadamard construction in 
order to obtain approximations of K{t,x,y) for small \t\. The immediate generalization 



of Hormander [IS], Thm. 17.5.5 to operators acting on vector valued functions provides 



Corollary 3.2 Let x eU . The distribution t — > trK{t, x, x) has an asymptotic expansion 

oo 

K{t,x,x):= Y C2fc(x)r2^ 

k=-n/2 

where the functions C2k o,re differential polynomials in the coefficients of the operator H . 
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A differential polynomial in certain functions is a polynomial in the various derivatives 
of these functions. The differential polynomials in Corollary |3.2| are homogeneous with 
respect to a suitable grading. Let Dj have the degree 1. We give H the degree 2. Thus 
Qij have degree 0, a, have degree 1 and a has degree 2. The total degree of a monomial in 
a differential polynomial is the sum of the degrees of the functions involved and the total 
number of differentiations. The C2k are related to the solutions of the transport equation 
18| , Eq. 17.4.6. Tracing back degrees we obtain 



Corollary 3.3 The coefficient C2k{x) of the asymptotic expansion ofTrK{t,x,x) is given 
by a homogeneous differential polynomial in the coefficients of the operator H of degree 
2k + n. 

Now Assume that the coefficients of the differential operator H are real analytic. 

Lemma 3.4 For x E U the local trace K{t, y, y) of the fundamental solution of the prob- 
lem (Qj is real analytic in t for small t > and has a convergent Laurent expansion in t 
att = 0. 

Proof: By the method of Hadamard we construct an approximate fundamental solution 
K{t,x,y). It satisfies the initial condition and 

{— + H)K{t,x,y)=:h{t,x,y) 

is real analytic in t, x for (t, x) inside the forward light cone near the tip (0, y) (we consider 
a fixed y E U) and, in fact, extends to a whole neighbourhood of (0,?/). Let hexit,x,y) 
denote this extension. The local trace of K{t, x, y) is a Laurent polynomial. We solve the 
Cauchy problem (^ + H)V{t,x,y) = —hf,xit,x,y) with zero initial conditions. Applying 
the Cauchy-Kowalevskaja theorem we obtain a unique solution V{t,x,y) which is real 
analytic in (t, x) near (0, y). Then K{t, x, y) = K(t, x, y) + x(^, x, y)V(t, x, y), where x is 
the characteristic function of the local forward light cone with tip (0,y). In particular, 
the local trace of K{t, y, y) near t = is given by a convergent Laurent expansion and is 
real analytic for small t > 0. □ 

3.3 The relation between A\ and A^ 

We choose coordinates near X 3 [1] G G/K using the exponential map. Let g = k © p 
be the Cartan decomposition of the Lie algebra g. We identify p = R" by specifying a 
basis in p. The composition of exponential map with the projection 

E : p '-^ G ^ G/K = X 

provides coordinates in a neighbourhood of [1] . The fibre of the bundle V over [1] can be 
identified in a canonical way with W = W^ © W~ (see (||)). We trivialize the bundle V 
in a neighbourhood of [1] using the radial parallel transport, i.e. the fibre of V over E{p), 
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p G p, is identified with W using the parallel transport along the path E{tp), t G [0, 1]. 
We can write the operator A'^ in the form 

n n 

A^ := Y^ aijDiDj + ^ ajDj + a, 

ij=l j=l 

where aij, aj, a are functions on p with values in End{WY^ . 

The Lie algebra of C^ is g"' = k © ip. We compose the exponential map with the 
projection in order to obtain coordinates on a neighbourhood of [1] G X^: 

E-.tp^'-^G'^^ Xd. 

The fibre of Vd over [1] is again canonically isomorphic to W. We employ the radial 
parallel transport in order to trivialize the bundle Vd in a neighbourhood of [1]. If we 
multiply the fixed basis of p by « we specify a basis of ip. We can write the operator A"^ 
in the form 

n n 

^d '■= J2 Ki^iDj + Y^ djDj + a, 

ij=l j=l 

where Di is the derivative d/d{ix^) and ajj, hj and a are EndiWy^-YdXned functions on 
ip. 

Lemma 3.5 The coefficients of A^ extend as holomorphic functions to a neighbourhood 
of in the complexification p'^. The following relations between the coefficients of A? and 
Al hold: 

di,j{ip) = aij{ip) 
dj (ip) = ittj (ip) 
d{ip) = —a{ip). 

Proof: The lemma is a consequence of the fact, that A^ and —A\ are restrictions to 
real submanifolds of the same holomorphic differential operator. Let G'^ and K*^ be the 
complexifications of the Lie groups. Then X^ := G'^/K'^ is a complex manifold. The 
representation of K on W^ can be extended to K*^. The Casimir Q!^ of G^ acts on sections 
of G'^ Xk<: W = V'^ ^> X'^. Let {A'^)'^ := Vl'^ — c{a). We use the exponential map of G'^ in 
order to provide holomorphic coordinates near [1]. 

E^ : p" '-^ G" ^ G7K" = X^. 

We trivialize the bundle V^ using the radial parallel transport. Then (A^)^ can be written 
in the form 

n n 
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where a^ ■ are holomorphic, End{Wy^-vaAued functions on p^ and Dj = d/dz\ where 
z^ is the complex coordinate corresponding to xK On one hand, by definition A^ is the 
restriction of {A'^Y ^o ^- Thus we obtain 

On the other hand, A\ is the restriction of —{A'^Y ^o X'^. Thus 

aij{ip) = alj{ip), dj{tp) = ia]{ip), a{ip) = -a^iip) 
and the Lemma follows. □ 



3.4 Computation of K{t) 

The coefficients bk of the asymptotic expansion near t = of K{t) are zero for odd k and 
given by homogeneous differential polynomials in the coefficients aij, aj, a of order k + n 
for even k. The coefficients bd,k of the asymptotic expansion of Kd{t) are zero for odd k 
and given by the same differential polynomials polynomial of degree k + n, but now in 
the coefficients (iij, cij, a. From Lemma ^]5| we obtain 

Lemma 3.6 The following relation between b^ and b^^k holds: 

bd,k = ^'+"&fc. 
The distribution K{t) is regular on R \ {0} and given there by 

Kit) = {-ir'^KM) = i-ir^'^^Mt). (4) 

vol{Xd) 

Proof: Since K[t) has a convergent Laurent expansion near t = the equality @ is true 
for small |t|. Since Kdiit) is real analytic for t G R \ {0} it is enough to argue that K{t) 
is real analytic for allt 7^ 0, too. □ 

The nature of K{t) as a distribution is obtained by specifying the regularization of 
the meromorphic function K{t) at zero. The type of regularization follows from Corollary 
^ Recall the proof of Lemma |2.5|. In a similar manner one can prove 



Corollary 3.7 In the case e = we have 



dd{t) = -^^^Q{^)ln{\sinh{Tt/2)\). 



In the case e = 1/2 we have 



ea{t) = -^^,Q{j^ln{\tgh{Tt/A)\). 
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In view of Corollary |X^ we obtain 

Corollary 3.8 As a distribution on R we have in the case e = 

and in the case e = 1/2 

3.5 The distributional trace formula 

Let G C^iR). Then 



-ft'Af,^ := / (f){t)cos{tAM)dt 
is of trace class. The linear map 

C^{R) 3<P^ TrKM,^ 

defines a distribution on R formally written as Trcos{tAM)- Recall the Definition ?? of 
C{g) = C{g,a) G R, l{g) G R for hyperbolic g E G. Let nr{g) be the number of classes 
in Tg/ < g >, where F^ is the centralizer oi g in T and < g > is the group generated by 
g. By CT we denote the set of conjugacy classes of F. 

Proposition 3.9 The distribution Trcos{tAM) is given by 

vol{M)K(t)+ Y: ^Mt-l{g)) + 6{-t-l{g))), (5) 

[9]6cr,[3]^[i] ^rl^j 

Proof: The operator Km,(I, has a smooth integral kernel Km,<i,{x, y). It can be obtained by 
averaging the integral kernel K^{x, y): 

where x, y are lifts of x, y with respect to the covering X -^ M. We identify the fibre 
Vx with Vgx, 5' G F using the homogeneous bundle structure of V. Since has compact 
support and cos(tA) has unit propagation speed, the operator K^ has finite propagation 
and thus the sum is uniformly finite, if x and y vary in a fundamental domain Q-p of F. 
We compute 



= / X! X! ^^ K^{x, hx)dx 

= ^ ^ / tr K^{x,h~^ghx)dx 
[g]ecr [h]er/rg -^^r 

J2 J2 tr K^{x, gx)dx. 



[slecr [hjer/r^ -'"'r 
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Since all g gT with g ^ 1 are hyperbolic, Tg = ^g^'^^^s) | 2; £ Z}. Thus, 

and 

U[/i]er/rg ^^r = fi<gi/nr(9)>5 

i.e. the fundamental domain of the group generated by g^l'^^^d). We obtain 

TrKM,(p= / tr K(j,{x,x)dx + ^ — — / tr K(j,{x, gx)dx. (6) 

The first term of (^ is nothing else than 

<vol{M)K{t),(l)> . 
The summands of the second term of @ were evaluated in Theorem ??. The result is 

^ ^ tr K^{x, gx)dx = ^U{l{g)) + 0(-/((7))). 



nr(5') yf^<<,> ' nvig) 

The proposition follows. □ 

4 The theta function 

4.1 The 74-index theorem 

Let 7 G -R(K) be such that its restriction to M vanishes, i.e. r(7) = G i?(M). Let 
yc ._ ycj^^-j _j^ ^c ]^g ^]^g associated Z2-graded holomorphic bundle. By Proposition 



3?6| there exists a C^-invariant, holomorphic Dirac operator W^ acting on holomorphic 
sections of V^. The bundle V^ restricts to bundles V ^- X and Vd -^ Xd, and D'^ restricts 
to Dirac operators D on V and tDd on Vd- Let L^ be an even, C^-invariant, holomorphic 
differential operator restricting to L on l^ and I'^Ld on Vd- Here q denotes the order of 
L^. We assume that L'^ commutes with D'^ and that L and Ld are formally selfadjoint. 
Let r C G be a co-compact subgroup such that M := r\X is a closed smooth manifold. 
Let Vm and Dm, Lm be the induced bundle and operators on M. Then we can define the 
A-index of D]\j and Dd- 

Definition 4.1 The A-index of Dm is the set of pairs 

indA{DM,LM) = {{^,n\)\\ eigenvalue of LM\ker{DM) ^i^^ graded multiplicity n\}. 

Similarly 

indA{Dd,Ld) = {{X,n\)\X eigenvalue of Ld\ker(Da) with graded multiplicity n\}. 
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Theorem 4.2 (The proportionahty principle for the A-index) 

X(M) 
mdA{DM,LM) = {{^ ''X,———nx)\{X,nx) e mdA{Dd,Ld)}. 

x[Xd) 

Proof: For all A^ G N we have 

{X,nx)&ndA{DM ,Lm) 



Analogously, 


i\,nx)eindA{Da,Ld) 


= TrL^EnJ 


For any t > 








TrLZEnAO] = 


TrLZe-'^'M 




TrL^EnAO} = 


TrL^e-'''"^ 



(7) 



holds. Now we argue as in Section ^^. We use the Cartan decompositions g = k © p and 
g(i = k © zp and the exponential map in order to provide local charts near the origin. We 
trivialize the bundles using the radial parallel transport. Then the operators Dfj and D'j 
are given by 

n n 

Dli = Y. ^ijDiDj + Y, ajDj + a 

i,j = l j = l 



Dl = Y. ^ijDiDj + Y «i^. 



J 



a. 



i,j=l j=l 

Let Di have degree one and fix the degrees of the coefficients such that D\j,D'j^ have 
degree two. The analogue of Lemma P3| holds: 



aij{ip) = aij{ip) 
Gj [ip) = laj {ip) 
d{ip) = —a{ip). 

Thus if ai{p) is a coefficient of D^^ then di{tp) = i'^^^^'^'^ a{ip) is the corresponding co- 
efficient of D^. The operators Lm and Ld also have analytic coefficients and are of the 
form 



Lm = 


- YliD^ 




\i\<i 


Ld = 


- YhD' 



\I\<<1 
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where / runs over a set of multi- indices. We fix the degree of the coefficients of Lm, Ld 
such that the total degree of Lm, Ld is q. We have 

The local traces of the operators on the r.h.s. of (^ have asymptotic expansions near 
t = (|jl5|). Let X denote some point in X^Xd. Then 



•k 



k=-n/2~Nq 

oo 

k=~n/2-Nq 

where bk and bk are the values at G p of universal homogeneous differential polynomials 
in the coefficients aij, ai, a, Ij and fijj-, cij, a, // of degree 2k + n + Nq. It follows 

b\ = ^^>'+-+^%,. 

Since the l.h.s. of (0) does not depend on t we obtain 

TrLZEn^^iO} = vol{M)bo 
TrL^EnAO} = i''^'"'vol{Xd)b, 

by integrating the local trace over X, Xd-, respectively. Using 

vol{M) _^„x(M) 



vol{Xd) x{Xd) 

we conclude 

and 

{X,nx)&ndA{DM,LM) W^d) (^x,nx)eindA{Da,La) 

This equation holds for all A^ > and thus implies 

X(M) 
indA{DM,LM) = {{^ ''A, nx)\{X,nx) e mdA{Dd,Ld)}. 

x{Xd) 

n 
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4.2 The multiplicities 

In this section we define the theta function 6{t) = 6{t, a) associated to an irreducible 
representation a G M. We will omit a in our notation but keep 7 in certain places. Let 
7 e -R(K) be admissible for a. We have defined the operator ^^(7) acting on sections of 
the graded bundle Va/(7) — > M. Let £'am(7) ^e its family of spectral projections. 

Definition 4.3 The integers 

m{\,-f) := TrEAj,ji^){\} 
are called the multiplicities. 
The reason for introducing the notion of cr-admissible 7 is to obtain the following 

Proposition 4.4 The multiplicities m{X, 7) do not depend on the choice of the a -admissible 

7- 

Proof: The proposition is a consequence of the A-index theorem that was proved in 



Subsection ^A\ Let 7,7 G -R(K) be two a-admissible elements. Then r(7 — 7) = 0. There 
exists an odd Dirac operator Dm '■= Dm^I,^) acting on sections of VAf(7) © Vm(7)°^ 
(Proposition |9.(j| ). This Dirac operator commutes with the action of Bm '■= ^m(7) © 
AMi'y)- The eigenspace of Bm corresponding to A splits as H{X) = H{X)'^ © H{X)^, 
where -ff(A)° is in the kernel of Dm and if (A)-*" is orthogonal to the kernel of Dm- On 
H{X)^ the operator Dm induces an odd isomorphism. Thus Trljj(^x)^ = (note that we 
take the super trace). Let indA{DM,B\j) = {{X,nx)}. Then Trljj(\)o = nx2. We must 
show that indA{DMiB\j) = 0. The operator Dm is a push down of a G-invariant Dirac 
operator D := D{'y,'y) acting on sections of ^(7) © ^(7)°^. The operator D extends to 
a C^-invariant, holomorphic operator on holomorphic sections of ^^'^(7) © V'^{'y)°P which 
in turn restricts to Dd on Vdi'j) © Vd{^)°P. Let Bd = Adi'j) © ^^(7)- Then -Bj is the 
analytic continuation of B^, where B^ is the lift of Bfj. Dd commutes with i?J. The 
yl-index theorem states that 

tndA{DM,Bl) = {{-X,^^nx)\{X,nx) eindA{Dd,B',)}. 

x{Xd) 

It is enough to show that indA^Dd, i?J) = 0, i.e. all nx vanish. Let (A, nx) G indA^Dd, Bj). 
The eigenspace Hd{X) of Bd splits into ifrf(A)° © Hd{X)^ with respect to Dd. On Hd{X)^ 
Dd induces an odd isomorphism. Thus TrlH^{X) = Trlu^^^xy^ = ''^a^- Since 7 as well as 7 
are a-admissible, it follows nx = 0. Hence, indA{Dd, -Bj) = and the proposition follows. 
D 

Let 7 G -R(K) be any cr-admissible element. We write m(A) := m(A,7), where m(A) does 
not depend on the choice of 7. Since Aj^ is elliptic and of second order, we have the 
estimate 

Y,\m{X)\<CR'', R»0 

with C < 00 independent of R. 
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Definition 4.5 For Re{t) > define the theta function 6(t) := 6(t,a) by 

e{t) := 5]m(A)e-*^ = Tre~'^^' . 

X 

6(t) is holomorphic for Re(t) > 0. 

4.3 Meromorphic continuation of the theta function 

Recall that we have fixed a cr G M. In this subsection we provide a meromorphic con- 
tinuation of the theta function to the whole complex plane and discuss its singularities. 

Theorem 4.6 The theta function 6{t) admits a meromorphic continuation to the whole 
complex plane. It satisfies the functional equation 

eit) + ei-t) = 2voi(M)K(tt) = 2^^i^eJtt). 

The singularities of 6{t) are 

• first order poles at t = ±tl{g), g G CT with residue 

C{g) 



rest=±d{g)9{t) 



Tcnrig)' 



• poles of order n at t = 27fk/T, k = —1, —2, . . . (at these points the singular part 
coincides with that of 2vol{M)K{it) ) and 

• a pole of order n at t = 0. 

Note that 2'n'k/T, k = —1, —2, . . . are the lengths of the closed geodesies of X^- 
Proof: We use the functional equation in order to define 9{t) for Re(t) < 0. For Re{t) < 
let e{t) := -e{-t) +2vol{M)K{tt). Then e{t) is meromorphic in the half plane {Re{t) < 
0} and has the singularities claimed in the theorem. Recall the explicit formula for the 



dual theta function given in Lemma |2.5| and that 2vol{M)K{t) = 2 ^j. \ Od{t). Obviously, 



2vol{M)K{it) is meromorphic. We have to show, that the two pieces on the left and the 

right half plane glue nicely at the imaginary axis to give a global meromorphic function. 

We define 61 as a distribution on U := C\{^N}. Let (p G C^{U). Then by definition 



< 9,(1) >= hm / 6{v)(j){v)dv. 

We compute the distributional derivative 86. Note that 6{tt + e) converges (considered as 
a distribution with respect to t) to a tempered distribution on R when e ^ 0. 

<de,(f)> = <e,d*(f)> 
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= Ume-,0 / o[~^ -^f-rlicl^iit + u) + (t>{--d - u)) 9{it + u)du dt 



oo poo Q Q 



+ lim^^QVol(M) / / [— — -———]d)(—it — u) K{—t + iu)dt du 

Je J-OD OU d[lt) 

= < ^{9{it + 0) + 9{-it + 0)) - vol{M)K{t), (t){it) > . 

The distributional trace formula states 

e{tt + 0) + e{-tt + 0) = 2Trcos{tAM) 

= 2vol{M)K{t) 

+ 2 E ^{6{t-l{g)) + 5{-t-l{g))). 
Thus, 

<ae,0>= E ^U{^l{g) + ct>[-^l[g))). 

[9]ecr,[3]^[i] ^rl^j 

Since d- = 7t6{z) we obtain that 9(t) is holomorphic near the imaginary axis except at 
t = ^il{g) g G CT, where it has first order poles with the residues claimed in the Theo- 
rem. The pole at t = can be discussed as in Duistermaat-Guillemin [H. □ 



5 The logarithmic derivative of the Selberg zeta func- 
tion 

Let M := r\X be a compact rank-one even-dimensional locally symmetric space of non- 
compact type. In this and the next section we develop the theory of the Selberg zeta 
function of M from scratch. We first define its logarithmic derivative as a convergent 
series on some right half-plane. Employing the relation of the logarithmic derivative of 
the Selberg zeta function with the trace of resolvents we provide a meromorphic extension 
and a functional equation. In order to obtain a meromorphic extension of the Selberg zeta 
function itself we have to show, that the residues of the poles of the logarithmic derivative 
are integers. This is done by interpreting these residues as dimensions of eigenspaces of 
suitable operators. The Selberg zeta function Zs(t, a) will be associated to an irreducible 
representation a G M. In the present subsection we fix a M-type a G M and a a- 
admissible 7 and omit a, 7 in our notation. 

5.1 Definition 

In this subsection we define the logarithmic derivative D{p) of the Selberg zeta function. 
Recall the Definition ?? of the length l{g) and of the contributions 

l(g)eP^^9Hra{m) 



C{9) 



2det{l - Ad{g)n) 
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where n comes from the Iwasawa decomposition G = KAN compatible with g, and 
m G M is defined by the representation g = ma, a G A"*". Recall the multiplicity nr{g) 
defined for (7 G F. 

There is a constant C < 00 such that 

C{g)<Ce-f^'^^h{g), VgeT hyperbolic. 

Moreover, using the volume growth on X, one has the estimate 

l{[g]eCT\l{g)<N}<Ce'^''. 



Definition 5.1 For Re{p) > p define the logarithmic derivative of the Selberg zeta func- 
tion by 

^ 2C(c/)e-P'(^) _ ^ l{g)e^P-P'^^^3)tra{m) 



[,]g^[,]^i nr(^) [,]g(i^[,]^i detil - Ad{g)^)nr{g) ' 

The function D{p) is holomorphic for Re{p) > p. 

5.2 Products and linear combinations of resolvents 

Let A be some operator. We set 

Rip) = -^- 

p + A 

Lemma 5.2 Let pi, ■ ■ ■ ,Pn & C be in the resolvent set of —A and pi 7^ pj for all i 7^ j . 
Then 

N N / N 1 \ 

i=i i=i \j=i,jjLiyj Pi J 

Proof: We prove this equation by induction on A^ using the resolvent identity 

{b - a)R{a)R{b) = R{a) - R{b). 

For A^ = 1 the assertion is obvious. Assume the assertion for A^. Then 

Af+l N f n 1 \ 

n^fe) = E n -—-] R{pi)R{pn^i) 
i=i i=i \j=i,j^iPj Pi J 

N ( Af+1 1 \ N ( Af+1 1 \ 

= E n — - fl(p.)-i: n — ^p(p..«) 
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It remains to show that 



N N+1 1 AT I 



S j=ljj^i Pj - Pi M Pj - PN+l 

or, equivalently, 

N+l N+1 1 

En 



^ i=i j¥i P^ P' 
This is a special case of the Lemma |5.3|. □ 



Lemma 5.3 For any N -tuple pi, . . . ,Pn & C of complex numbers with pi ^ pj for all 

i ^ i and / = 0, 1, . . . , A^ — 2 we have 

N+l N+l 1 

E^i n ^ = 0. 

i=l j=l,j^i Pi P^ 



Proof: Consider 



N+l N+l 1 



fipi)--=Y.pi n ^^=0 

j=l j=l,JT^i Pi Pi- 



as a rational function of pi. It can have poles of first order at pi = Pj, j = 1, . . . ,N. 
Actually, we show that the residues vanish and, hence, / is entire. The assertion of the 
lemma follows, since for I < N — 2 the function f{pi) is bounded and tends to zero at 
infinity. We compute 

resp, =p^ f{pi) = limp, ^p^ f {pi ) {pi - pj ) 

N+l 1 N+l 1 



-Pi n -^+p', n _ , 

k=2,k^jPk Pi k=2,k^jPk Pi/^p^^p^ 





n 



5.3 The trace of the product of resolvents and meromorphic 
continuation of D{p). 

Recall the Definition ^]l] of the operator Am- Let L < oo be such that — L^ < A\j (note 



that Am may have imaginary eigenvalues). Then for Re{p) > L 



oo 



p2 + Al, Jo Am 
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Let pi, . . . ,pn € C be complex numbers with pi ^ pj for all i ^ j and Re{pi) > L. 
Employing Lemma E^ we can write 



N N / N ^ 






In order to simplify the notation we will write 



N I N -\ 

Pit 



The symbol ^ stands for forming the corresponding linear combination of the function 
being the argument of \1/ with p replaced by the Pi. For example, consider the function 
sinh{j)t). Then 

TV / TV ^ \ 

'^{sinhipt)) := E IT -T^-^sinh{pit) . 

i=l \j=l,jj^iPj Pi J 

Thus 

^ "'^ sinitAi 



~_i JO Am 



From Lemma 15.31 we deduce: 



Lemma 5.4 Let a^ + tai + t^a2 + ■ ■ ■ he the Taylor expansion of ^{f{pt)) as a function 
of t at t = 0. Then a2n = for n = 0, . . . ,N — 1. 

Recall that n = dim{M). For A^ > n/2 + 1 the product 

N 

n Rip") 

i=\ 

is of trace class. Recall the distribution Kif) obtained in Corollary |3.8| and the Definition 
Oof e:=e(a) G {0,1/2}. Let 



F{t) := ln{\sinh{Tt/2)\), case e = 
F{t) := ln{\tgh{Tt/A)\), case e = 1/2. 



Proposition 5.5 {D and the trace of resolvents) For N > n/2 + 1 and pi, . . . ,p]\f G 

C with Re{pi) > L and pi ^ pj for all i ^ j 

Tr n R{pI) = -Y^) r '^(PQ(P)^~'")P(t)dt + ^(^) (9) 

holds. 
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Proof: Let 0e(t) be a smooth cut-off function being zero near t = and for t < and 
(j)e{t) = 1 for t > e > 0. 

Lemma 5.6 

n Ripl) = Um.-.o r 0e(t)v&(e-^*)^^^^^dt (10) 

Z_i -'0 Am 



1=1 



in the sense of trace class operators. 

Proof: Let Q be tlie projection onto tlie complement of tlie kernel of Am- It is enough to 
show that 

f[Rip^) = /zm_o r Mt)^{e-^Y-^^^^Qdt 
iJy Jo Am 

in the sense of trace class operators. Integrating partially 2i?-times, we obtain 

Jo Am Jo ^ ^ {AmY^^^ 

Now we can carry out the limes e —>■ and obtain 

Jo Am Jo ^ ^ (v4m)^^+^ 

in the trace class. Since the application of \E' kills the even Taylor coefficients of \l'(e~^*) 

by Lemma |5^ , if 2R < N we can partially integrate back to obtain the desired result. □ 

(Lemma ^.6|) 

Interchanging the trace and the limes e — *> in (0) and integrating partially once we 

obtain 



^ fOO 

TrT\R{pf) = lim.^oTr 0e(t)^(e^ 
T^ . Jo 



pt 



sin{tA 



M , 



dt 



i=i ^0 Am 

("OO / ("OO \ 

= lim.^o Tri (f),{s)^{e-P')ds] cos{tAM)dt. 
We apply the distributional trace formula and obtain 

N 

Trn^(p-) 



i=l 



= hm,_,oVol{M) / K{t) ( / ^,{s)<i/{e-P')ds] dt (11) 

+ Um.^o E ^J rMs)^{e-nds]. 
The second term gives 

[,lscr,bl^i "r(g) \Ju<,)~ J biecrjsl^i "r(9) P 

^ 2p ' 



5 THE LOGARITHMIC DERIVATIVE OF THE SELBERG ZETA FUNGTION 28 

The function /(t) := /j°° 0e(s)\l/(e~^*)(is is not compactly supported. In order to apply 
the distributional trace formula one first cuts off at large |t| and extends the function 
symmetrically to the negative real axis. Since f{t) is constant near t = one obtains a 
smooth function with compact support. Now the trace formula will be applied. In the 
resulting equation one lets the cut-off tend to infinity. 

Inserting the formula |3.(j| for K{t) into the first term of ( ]TT| ) and using 



we obtain 



/■OO / ("OO \ 

lini,^QVol{M) / K{t) { / (j),{s)^{e~'")ds\ dt 
X{M) 



TxiXd) Jo 

n 

Next we compute the integral 



'^{pQ{p)e-P')F{t)dt. 



X{M) 



Ty Xrl) Jo 



Tx{Xd) Jo 

This integral converges for Re{pi) > 0, i = 1, . . . ,N and defines a holomorphic function. 
Integrating by parts we obtain 

y(M) r°° f "°^^^*'^/^^ e = 1 

^^■=-VT^^ ^(Q(p)e-^*) !!:T(!^' / ./, \dt. 

MXd) Jo [ -^mWW)^ e = 1/2 J 

In the case e = we use ctqh(x) = 1 -\ — ^ttt in oder to write 

J \ y sinn(x) 

_xiMl Q^ _ x{M)_ r- ^.g. . -%+T/2). I ^, .^2) 

2x{X,f^ p ' 2x{X,)Jo ^^^^^'"^ Kinh{tT/2r- ^''> 

Thus / is a meromorphic function up to Re{pi) > —T/2, i = 1, . . . ,N. 
We decompose / into an even and an odd part: 

lev ■■= 2^Hpu ...,Pn) + li-Pu • • • , -Pn)), lodd ■■= 2^HPi^ ...,Pn)- H-Pu ■ ■ ■ , -Pn))- 



Lemma 5.7 



_X{M)_^ ( i tginp/T), e = 1/2 

'"'' X{X,) 2T^ ["^^P' \ ~ctg{7rp/T), e = 
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Proof: We first consider the case e = 1/2. We have 

y(M) f^ 1 

Assuming \pi\ < T/2, i = 1, . . . ,N for a moment we can apply the formula Ryshik/Gradstein 



271, 3.311, in order to obtain 



Io,, = ^p,^^{Q{p)tginp/T)). 
x{Xd) 2T 

Now we consider the case e = 0. We must compute the odd part of 



Jo smhitl 1) 



2xiXd)Jo ' '' \sinh{tT/2) 

where we can apply formula Ryshik/Gradstein |^, 3.331, and obtain 






2x(A'j) * p ' 2x(Xi)2T 
Combining this with equation (p!2D gives the desired result □ 



We have not found an explicit formula for the even part /g^, though it is likely that 
there is a way to carry out the computation. 

Lemma 5.8 The function lev is global meromorphic and given by the trace of a holomor- 
phic family of trace class operators 

""■ x{X,)i\ri-Ai- 

Proof: Using Corollary |3.7| we can compute: 



^ev 






ev 



x{Xd) \2p'Aa + p Ad-p' 

X(M)_ ^, 1 , 



x{x,y'^'p'-A^ 



d 

N 



X(M) ^ 1 



X{X,) t\ p^ - Al 
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n 

Thus we have found a meromorphic extension of the integral / = lodd + hv to all of 
C. 

Proposition 5.9 The logarithmic derivative of the Selberg zeta function has a meromor- 
phic extension to all of C and is given by 



2p t\P^ + ^l 



M 



N 



TrU^-^ (13) 

x{X,)2T^y^^P>\-ctg{rrp/T) e = Of) ^'^^ 

X(M) 



N 



TrE. 



xiXd) t\ vi - A\ 

This equation is viewed as an equation of functions in p := pi while the other pi, i > 2, 
are kept fixed with Re{pi) » 0, pi ^ spec{Ad). The singularities of D{p) are : 

• first order poles at p = ±t\ with residue m{X) if X ^ is an eigenvalue of Am, 

• a first order pole at p = with residue 2m{0) if is an eigenvalue of Am, 

• first order poles at p = —A G T(N + e) with residue —2 ^L l m(i{\). Then \ > is 
an eigenvalue of A^. 

If two such points coincide, then the residues add up. 

Proof: We only have to discuss the singularities. The poles of the integral I are located 

at T(N + e). Ad may have more eigenvalues, in fact even imaginary ones, but we have 

chosen the 7 G -R(K) such that those eigenvalues cancel out each other. The weighted 

multiplicity of the eigenvalues of Ad are md{\) = \Q{\). In particular, lev is regular at 

p = 0. The poles of lev and I^dd cancel each other on the positive real axis and add up on 

the negative real axis. Consider the case e = 0. lodd has poles at p = —kT, k = 1,2, . . . 

with the residue 

X(M) il / 1 \ m,{-kT) 

x{Xd) t\[p' - PV -2A:T • 

Thus D{p) has a pole at p = ~kT and / contributes to the residue by 

-^^ITrmdi-kT). 
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In the case e = 1/2 the poles oi lodd are located at (— A; + 1/2)T, A; = 1, 2, . . .. / contributes 
to the residue of D{p) at p = {—k + 1/2)T by 

-2^md{{-k + l/2)T). 
x{Xd) 



Let now A 7^ be an eigenvalue of Am with m{X) 7^ 0. Then the singular term at p = ±zA 

1 



m 

N 



TrY[ 



i=\ Pi + ^M 

is 

m(A)n 



N ^ ^ 



It contributes to the residue oi D{p) hy m{\). The case A = is discussed similarly. □ 



Proposition 5.10 (All residues integer) At all singularities of the function D{p) the 
residues are integers. 



Proof: By Proposition [5.9| the residues of D{p) are sums of multiplicities m{X) and ex- 
pressions 

x{Xd) 



Hence, it is enough to show 
Lemma 5.11 



X(M) 



Proof: It is enough to provide an elliptic homogeneous (with respect to G'') differential 
operator Dd on Xd with index{Dd) = 1. Then there is a corresponding homogeneous 
operator on X inducing D on M. By the proportionality principle (a special case of 



Theorem 4.2) 



xm ^ rndex{D) ^ 

xiX'^) index{Dd) ^ ' 

is an integer. In fact, we show in Theorem |9.5| that any representation of G'^ can be real- 
ized as the G'^-index of a homogeneous Dirac operator. In particular, we can realize the 
trivial representation, which provides an index one operator. □ (Lemma and Proposition) 
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6 The Selberg zeta function 

6.1 Singularities 

We adopt the same conventions as in Section |^. There, we constructed the logarithmic 
derivative D{p) := D{p, a) of the Selberg zeta function as a global meromorphic function 
such that all its residues are integers. Let po ^ (p, oo) and define 

/■oo 

C{po) = exp{- / D{p)dp). 

J pa 

The integral converges since for some C < oo depending on po the estimate 

\D{p)\<Ce-^^-P^'\ peipo,oo) 
holds. Since all residues of D{p) are integers the Selberg zeta function is well defined by: 

Definition 6.1 The Selberg zeta function associated to M and a G M «s defined by 

fp 
Zs{p) ■■= Zs{p, or) := C{po)exp{ / D{s)ds). 



PO 



The constant C{po) is chosen such that Zs{p) tends to one Up approaches infinity on the 
positive real axis. An immediate consequence of Proposition [5.9| is 



Theorem 6.2 The singularities (zeros have positive and poles negative order) of the Sel- 
berg zeta function are: 

• at p = ±zA of order m{X) if X ^ 0, where A is an eigenvalue of Am, 

• at p = of order 2m(0) if is an eigenvalue of Am, 

• at p = —A, A G T(N + e) of order —2 ^1^ l md{\)- Then \ > is an eigenvalue of 
Ad- 

If two such points coincide, then the orders add up. 

6.2 Euler product 

The Selberg zeta function is usually defined by an Euler product. The following propo- 
sition establishes that our Selberg zeta function coincides with those considered by Fried 



rg, Gangolli ]ll and Juhl pi 



We say that [g] G CT is primitive, if n^ig) = 1. 
Proposition 6.3 (Euler product) For Re{s) > p we have 

oo 

Zs{s) = n U det[l- e(-^-^)'(5)5^(Arf((7)„i) ® a(m) 

[g]eCr, [g]^l, primitive /c=0 
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Proof: Let W G End{C^) be some matrix such that 1 — W^ is invertible. Let ai, . . . , a„ 
be the eigenvalues of W. Define the /c'th symmetric power of W by 

■^ . ■- 

k 

Then 

trS''W= J2 aY...ai^. 

ii+...in=k,ij>l 

Assuming for the moment Oj G [0, 1), Vi = 1, . . . , n, we get 

1 



Ott 



det(l-W) fJi(l-aj] 

n oo 

= nE4 



oo 



^ ^ aY. ..a: 

fc=0 ii + ...+in=fc,*j>l 
oo 



^ tr S'^W. 



k=0 

Note, that dim{n) is odd. We can compute 

e(p-'^)'(<y)tro-('m) 



/n(Z5(.)) = E 

E 



[^]g(^[^]^i c?et(l - Ad{g)n)nrig) 
[g]e^[g]^i detil - Ad{g)-^)nr{g) 



- Y. J2^'^'^''^^^^^^r\9)trS''{Ad{g)^^)tra{m) 

[9]<^Cr,lg]^lk=0 



oo oo 

-A~P~s)JI{9)a-1( qki 



E E^^Ee^~'~'^''^'^r'(^'(M^)n)-^') ® ^(m^ 

[g]eCr, [g]7^1, primitive fc=0 j=l 

oo 

^ ^ tr /n (l - e(-^-^)'(^)5'=(Arf(^)„i) ® a(m; 

[g]eCr, [g]7^1, primitive fe=0 

oo 

J2 Y.^n det (l - e^-f'-'^^^<^^ S\Adig)^^) ® a(m; 

[g]GCr, [g]7^1, primitive A;=0 



Exponentiating this equation we obtain the assertion. □ 
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6.3 Functional equation 

Theorem 6.4 The Selberg zeta function satisfies the functional equation 



Zsi-n) ' \ X-(.f J T k '^^■" \ -ctgiirp/T) i = 

Proof: If one takes the difference of the representations of the logarithmic derivative D{p) 
given in Proposition ^.91 for p and —p, then the terms involving resolvents cancel out. One 

obtains 

D{p) + D{-p) ^ _xiM)_7^ f tg{np/T) e = 1/2 1 

2p x{X,)t'^^^^\ -ctg{np/T) e = f' 

Multiplication by 2p and integration from pq to p leads the desired formula. □ 

The existence of a functional equation of this type up to an exponential polynomial 
was already pointed out by Juhl []2T| and was established by Brocker [Q]. There is a similar 



functional equation for Wakayama's Selberg zeta function ||3 

6.4 Representation by regularized determinants 

For \Re{pi)\ large we consider the function Lm oi pi, i = 1, . . . ,N : 

Lm{pi, ...,Pn):= Tr ^(— — -^). 

We can write 

LMiPi,...,PN) = Trv|/(re-*(p'+^M)dt) 

Jo 

Jo 2pdp t 

= ^{-^P.F. r Tre-'^'^^M^'^-), 
2pdp Jo t 

where P.F. /q°° . . . stands for taking the finite part of J^ .... 

Applying Soule-Abramovioch-Burnol-Kramer, B^, Theorem 5.1.1, we obtain 



Lm{pi, ■■■,Pn) = ^{^-^{Hdetip'' + Al,)) + Eu aAf(p'))). (15) 

The determinant is the zeta regularized (super) determinant of p^ + A\j defined by 

Inidetip" + Al,)) := -P.F. H Tre-'^P'+^M)^ _ EuaM{p^), 

Jo t 
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where auip^) is the constant coefficient in the asymptotic expansion of Tre~^^^ +^m) at 
t = and Eu is the Euler constant. Let 7 = Y.l=ikiSi E -R(K), Si G K, fcj G Z, be 
cr- admissible. Then ^4^(7) sphts as (B[=i ©j=i ^M(<5i,o") and 

I 

i=l 

Equation ( P^D extends analytically to all of C. In an analogous manner one obtains 
for \Im{pi)\ large 

Ld{pi,...,PN) ■= -Tr^' 



Al-p^' 



= ^{^^{ln{det{Al-p^)) + Eua,{p'))), 

where ad{p^) is the constant term in the asymptotic expansion of Tre~*^^d-P ) at t = 0. 
Note that auip^) = (x ) ^dip'^)- In the following equation derived from (|T3|) the terms 
involving qm and a^ cancel out. 

^ 2p > x{X,)2T^y^^P>\ -ctg{np/T) e = j) 

+ nT^Hdetip' + Al,))) 
Ipdp 



m[--ln{det{A',-p'))). 



It follows 



x{Xa) '2pdp 



""^^^ - "^^^^ ~ ^ra T^"^^^^ 1 -ctgMT) e = 

+ —ln{det{Al^ + p")) 
dp 



x{Xd) dp 



ln{det{Aj-p')), 



where -R(p)' is a certain odd polynomial. Integrating once and exponentiating we obtain 
that the Selberg zeta function has the representation 

Zs{p) = e^(P)det(p2 + Ai,)(det(A2-p2))-x(M)/x(x,) ^^g^ 

■ ""^^1, x{Xd)TJo'^^''\~ctg{7rs/T) e = / ^'j " 
Note that the exponential of the integral on the r.h.s. of (TTBI) is well defined since the 



residues of the integrand are integers by Lemma 5.1L 
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Lemma 6.5 R{p) = 

Proof: We thank U. Brocker for suggesting the following argument. Let Z^{s,X) :- 
Tr{Ad ± A)-" for s » and ±A > 0. Since 



9,it)=Tre 



-tA. t-^0 



E dkt' 

k=—n 



(note that rf^ = for k odd) Z^{s^ A) have meroniorphic continuations with respect to s, A 
and -D^(A) := e^d^^ («'-^) = det(Ad =]= A) are well defined entire functions of finite order 
having zeros at ±A E L = spec{Ad) of multiplicity ^^(iA). The WeierstraB products 






,^ A, ^{±xy 



md(p.) 



are other entire function of the same order and with the same zeros such that they differ 
from ^^(A) by exponential polynomials of order n, only. By results of Voros [?] these 
polynomials are known. Let Z^{s) := Z^{s,0). Then 



D±(A) = A±(A) 



exp 



iZ^nO) - E RF.Z-- 



[■m] 



[±xy 



m=l 



m 



n (m—\ 1 \ \m\ 



m=l 



, r=l 



r ml 



Now 



A(A) := A+(A)A-(A) 



n 

/iG-L 

n 



A 



1 ^)exp 2 E fracVrfi'^ 



/i 



r=2,even 



nidip) 



1 — )CX7) I / 



mdip) 



(19) 



is the WeierstraB product corresponding to the eigenvalues of A'^, where z = X'^. Note 
that 

oo 
k=-n/2 

In general one would expect half interger exponents, too. But these do not occur in our 
special case. Let Z{s,z) = Tr{Al + z)-' and D{z) := e^^^^'"''' = det{Al - z). Then 
again by the results of Voros 

D{z) = A{z) 



n/2 



exp 



-Z'{Q)-Y.P-F.Z{m)—-Y: 



m=l 



m 



m=i "Vr=i r) m\^' 



(20) 
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Note that Z+{s) = Z~{s) = Z{s/2). Combining (|T|), (0), (0) and (^ we obtain 



( ^ (^r 

y m=l \r=l ' , 



m=i,even \r=i ' / '"'• 

We recall the reflection formula proved by Brocker |^, Lemma 4: 



D-{X) ^ V ^ -^0 I -ci^(^^/^) e = 

We get 



,2 / ^ r ni \] tai^^/T) e = l/2 



D(y) = ^-w^-p -^/„ ^Qw _:4'i;';^ 7=0 ''^ 



n/2 /m-1 ]^\ \2m 



.„=1 Vr=l rj ^'- 



m—1 1 \ \m 



+2 E rf-™(E-)-, 

m=i,even \r=i ^ / ^^' 

We now insert this into (p!6D and obtain 
Z(p) = det(p2 + Ai,)det(Ad + p)-2>^(^^)/>^(^'*) (21) 

We determine -R(p) from the asymptotic expansion of the logarithm both sides as p ^ 00. 
In fact, log Z{p) vanishes exponentially as p -^ 00. Let 

00 

k=-n/2 

define the coefficients e^. Note that e^ are connected with the c^ by the proportionality 
principle, i.e. e^ = for k odd and 

X{M) 
x{Xd) 

for k even. We have 

log detiAl + p') '^' J: e.,(logip')-(xl]]^ + eolog{p') + oil) 
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and 



log det{AD + p) *~° Yl ^-^ [ ^^gip) - ( Zl ~ ) ) Tf + dolog{p) + o(l). 



Inserting these expansions into (pT]) we get 

-R{p) = ^^{colog{p^)-2dolog{p) 



n/2 ^ 2m n \ rf^ 

^1 "^ "^' m=iVven "^ "^' 

Now we claim ^^ = ,~^Y^ . Assuming this claim R{p) = immediately follows. To see 
the claim note that Z{s) = Z^{2s), /l^x, = reSs=-mZ{s) and j^r^rih = reSs=-2mZ^{s). 



(m-iy. ■ ^'^s=-m^\'^j "^^^ (2m-l)! 

this ■ " 



We thank U. Brocker for suggesting this argument. An immediate consequence of Lemma 
31 is 



Proposition 6.6 The Selberg zeta function has the representation 

Zs{p) = det(p2 + 0(det(A^-p2))-x(Af)/x(x.) (22) 

■ '"'Py x{X,)TJo''^^'^\-ctg{7^s/T) e = j ^^'J ' 

Proposition |6.6| implies that the Selberg zeta function is completely determined by the 
spectral data. This is not surprising in view of the fact that the geometric data defining 
the Selberg zeta function occurs as the residues of the theta function, se 

7 The Ruelle zeta function 

7.1 Definition and relation with the Selberg zeta function 

We discuss the Ruelle zeta function of compact rank-one locally symmetric spaces M of 



non-compact type. Ruelle ||2^ introduced a zeta function for Anosov flows coding the 
length spectrum of closed orbits. In our situation the corresponding flow is the geodesic 
flow on the unit sphere bundle of M. The closed orbits correspond to closed geodesies 
and thus to the conjugacy classes of F. 

Definition 7.1 The Ruelle zeta function of M is defined by the infinite product 



Zr{s) := n (1 - e-^'(^))-i 

[g] SCr , [9] ^ 1 ,primitive 



converging for Re{s) > 2p. 
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Consider a conjugacy class [g] G CT. To g E [g] we associate an adapted Iwasawa 
decomposition G = KAN of G. Recall that M := Ga H K. Then g = ma with m G M 
and a G A+. We identify A = R using the exponential map. The Riemannian metric 
of X induces a metric A and l{g) is the length of a with respect to this metric, i.e. the 
length of the closed geodesic of M corresponding to [g] . 

It was discovered by Fried [^ that the Ruelle zeta function can be expressed in terms 
of Selberg zeta functions. In the present subsection we provide a short derivation of this 
fact. In the following subsection we use this representation in order to discuss properties 
of the Ruelle zeta function. 

Let n*^ be the complexification of the Lie algebra of N. For p > consider A^n'^ as 
a representation of MA. Any A G R induces a one-dimensional representation of A on 
C;, := C by A 9 a ^ e^^^sia) _ x^ere are sets 

lp = {{a,x)WeM,xeR} 

such that APn'^ decomposes with respect to MA as 

where K- is the space of the representation a. We define 

S{s,p):= n Zs{s + p-x,(^)- 

Proposition 7.2 The Ruelle zeta function has the representation 

n-l 



Zr{s)=1[S{s,p) 

p=0 



(-1)^ 



Proof: We employ the following fact. Let IV be a vector space and A G End{W). Then 

oo 

J2 tr(-l)'A'A = det{l - A), (23) 



/=o 



where A'' A is the induced operator on A^W. 

Consider [g] G CT and adapt the Iwasawa decomposition oi G to g = ma. Combine 
the contributions of [g] to all zeta functions occurring in S{s,p). Then the contribution 
of [g] to lnS{s,p) is 



g-^Ks) 



det{l - Ad{g)nc)nr{g) ^^^^^^ 



We can also write 



L{s,g,p) = —— , , , — --trAPAd{g)nc. 

det{l - Ad{g}nc}nr{g) 
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Forming the alternating sum over all p we obtain 



n-l p-sl(g) 

^0 Ma) 



Thus for s >> 



n-l p-sl(g) 

Y.{-mnS{s,p) = T. -T-S 



oo -skl(g) 
[g]£Cr,[g]^l,prir7iiiTOe fc=l 

[g] SCr , [g] ^ 1 ,primitive 

lnZii{s) 



a 



The representation of the Ruelle zeta function provides its meromorphic continuation 
to the whole complex plane. That the Ruelle zeta function has a meromorphic continua- 
tion was observed in Ruelle's original work by dynamical methods (|2f 



7.2 The functional equation for the Ruelle zeta function 

We employ the functional equations for the Selberg zeta functions in order to provide a 
functional equation for the Ruelle zeta function. First we write 

Here we used the Poincare duality, i.e. for p < n/2 — 1 

In~i-p= {((7, 2p-x)|(cr,x) e Ip}. 
Using the functional equations for the Selberg zeta functions we obtain 

y f \y f \ ""'jl^ ( TT ^^(^ + P - X. (^)Zs{-s + p - X, ^) ^ i^.. 

Zr[s)Zr[-s) =11 11 ^7 ^ V^^ V ^^ 

p=o V(-,x)e/p ^^^~^ + X - P, (y)Zs{s + x-p,(r)J 

- -(-ffiii5v.r,Ej::::v,,..,{4;:(^, i^-r)4 

Let h{s) denote the derivative of the exponent (up to the prefactor), i.e. 

n/2-l 

h{s) = E(-ir E {P{s+{p~x),^)-P{s-{p-x),^)) 

r tg{n{s + {p-x))/T) e(a) = 1/2 1 
1 _ct^(^(s + (p-x))/T) 6(a) = /' 
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where we have used the periodicity of tg and ctg and that p, x G |TZ. Since A^n^ is a 
representation of MA we have, using the definition of e{a), 

Teia)+x + peTZ, V(a, x) G V 

Hence, 

n/2-l 

h{s) = -ctg{7rs/T) J2i-^y E {P{s + {p - x),cr) - P{s - {p - x),^))- 
Let -f/^(s) be the polynomial 

ra/2-l 

Lemma 7.3 The polynomial H{s) is a constant 

71 

His) = -x{X,). 

Proof: The claim is a consequence of identities in the Weyl polynomials. In order to 
establish them we employ a geometric argument. It is enough to evaluate H{s) at a large 
number of points. 

Recall the Borel-Weil-Bott theorem. Let A*^ = expiiSi) C C^. Extend Ca to a 
representation of A'^ for A G \TZ. Let (x G M. If A G R is such that Te{(y) + p + A G TZ, 
then the representation Vcr®C\ exists as a representation of MA"^. Form the holomorphic 
vector bundle 

W{X, a) = C^ Xma<* (K ® Ca) ^ GVMA'^ =: B. 

The Borel-Weil-Bott theorem asserts that the representation of G'' with the highest weight 



A = po--|- A (see Subsection ^^ for conventions) can be realized as the space of holomorphic 
sections of W{\, a) and all higher cohomologies of W{X, a) vanish. A consequence of the 
theorem of Borel-Weil-Bott is 

P(A + p, a) = Xa{B, W{X, a)), A + p + Te{a) G Z, 

where Xa is the analytic genus of the bundle W{X, a), i.e. the Euler characteristic of the 
complex given by the Dolbeault resolution of W{X, a). Thus 

P{X + p,(j) = index{d + 9*), 

i.e. P(A-|-p, 0") is the index of the Dirac type operator d + d* on a Z2-graded vector bundle 
I\P'*T*B ® W{X, a) (the grading given by even and odd form degree). For p < n/2 — 1 let 

Hp{s)= E P{s + P-X,cr)- 
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For s such that s — x + Te^cr) G TZ, i.e. s G TZ, we have 

Hj,{s) = Xa{B, ®{a,x)ei,W{-x + s, a)). 
But 

Now 

and we obtain for p < n/2 — 1 

H,{s) = Xa{B,AP'''T*B ^W{s,l))- 



For p > n/2 — 1 let 



ffp(s)= Y. P{s-P + X,(t). 

(o".X)G-fn-p-l 



Applying the consequence of the Borel-Weil-Bott we obtain 

Hp{s) = Xa{B, ®ia,x)€l„.,.,W{x + S-2p, 0")). 

But 

C^ X MA'^ (©(a,x)e/„-p-i K ® C^ ® C,_2p) = C^ X MA'' A^'P-^n^ ® C,_2p) 

= G'^XMA''A^(n^)*®C,) 
= AP'°T*5(8)iy(s, 1). 

Since if(s) = J2pZo{-'^)^Hp{s) we obtain that H{s) is the index of (d + d*) on the bundle 

A*'*T*B O iy(s, 1) = A*T*5 (g) iy(s, 1). 

Now the differential operator (d+d*) can be deformed to D = V + V*, where V is induced 
by the Levi-Civita connection of B and the homogeneous connection on W{s + p, 1). Here 
V acts by alternating differentiation. The deformation is given by 

Dt = {d + d*)+t{d + d*) 

and stays inside the elliptic operators, d is again defined using the connection. The index 
of Dt is independent of t and for t = 1 it is independent of the twisting line bundle and 
equal to indexDi = x{B)- The Euler characteristic of B can be expressed in terms of Xd 
(see Juhl 0) xiB) = fx(Xd)- □ 
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Now we come back to discuss the functional equation of the Ruelle zeta function. Note 
that h{s) = —n/2x{Xd)ctg{Tis/T) is the derivative oi C — ^x{Xd)in{\sin{Tis/T)\) for any- 
constant C. Hence 

'T'ti 

= C-—x{X,)ln{\szn{ns/T)\). (25) 

We argue that C = 0. We consider the asymptotics of both sides of this equation for s -^ 
zcx). The r.h.s. behaves as C — ^xiXdj^s + 0(e*'^^) for some c > 0. A first approximation 
for large Im{s) of the l.h.s is 



E(-ir E / , , P(r,a)dr + 0(e^' 



p=o (<T,x)e/p-'''~(''"^) 



The integral 



s+(p-x) 

P{r, a)dr 

s-(p-x) 



is an odd polynomial in s since P{r, a) is odd. In particular, its constant term vanishes. 
Thus, the constant term C of the r.h.s. of ( pSf ) must vanish, too. 
Inserting ( pSD into (|2^) we obtain 



Theorem 7.4 T/ie Ruelle zeta function satisfies the functional equation 

Zr{s)Zr{-s) = szn{7rs/Tr^^^'\ 

In particular, the order of the singularity at s = is |x(^) while the order of the 
singularities at s < —2p, s G TZ is nx{M). 



Juhl [^ obtained this functional equation up to an exponential polynomial. As in the 
real and complex hyperbolic case (see Section ^ it would be interesting to know the set of 
operators which contribute to the divisor of the Ruelle zeta function in the quaternionic 
hyperbolic and exceptional case. 

8 Examples 

8.1 Forms on the real hyperbolic space 

Let G = SO{n, 1), K = SO{n) and M = SO{n — 1) for n = 2m even. The correspond- 
ing symmetric space of non-compact type is the real hyperbolic space HIV^ of sectional 
curvature —1. It's compact dual space is the unit sphere S"". Let M := r\X be a 
smooth, closed hyperbolic manifold. We consider the Selberg zeta function associated to 
the M-types related to the differential forms on M. 
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Let A^ := A'PR" be the exterior powers of the standard representation of SO{n) and 
let a^ := A^R""^ be similarly defined for SO{n — 1). We have the decomposition rules 

r{\P) = aP + aP-\0<p<n/2, r(A°) = a°, 

where r : -R(K) — * i?(M) is the restriction. We can represent the M-types a^ by restricted 
K-types as follows: 



a° = r(A°) 




a' = r(Ai-A°) 




a' = r(A2-Ai + A°) 




a^ = r(^(-l)'-^A'), 


< p < n/2. 


/=o 





(26) 

These representations are admissible. In fact, in L^{HIV^,A*T*HH'^) discrete series rep- 
resentations only occur on the forms of middle degree. But these forms are not in- 
volved in (pGl). As remarked in the introduction, the absence of the discrete series (in the 
weighted sense) on the non-compact side is equivalent to the fact that the representation 
of the M-type is admissible. Thus the singularities of the Selberg zeta functions Zs{p, cr^) 
are related to the eigenvalues of the Laplace operators A\,j on the j-forms on M and 
^^^,0 <j <p< n/2. We have c{aP) = {^^^^^f. 

Proposition 8.1 The Selberg zeta function Zs{s,(J^), p < n/2 has the following singu- 
larities: 

• azero atOy^s = iXeiRU (-^^^^, li^^) of order 

dtm{AljUj = (A' + (^^— ^— ^)2)cu, 6uj = 0}, 

• a zero at s = of order 

2dim{A'j^jU = ( Yuj, 6uj = 0}, 



at s = ^^^^ of order 



j:{-iy-'bi{M), 



at 8 = -!i4p2p ^y ^^^g^ 



p n~p—l 

Y^i-iy-PbiiM) + {-ir+\{M) = Y: (-1)'+%(M), (27) 

1=0 1=0 
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• atR3 s = X< -B^1-2p of order 



2 n-l-2p^ 



-x(M)rfzm{A> = (A^ - ( ^)>, S^ = 0}. 

There are related results on the Selberg zeta function for differential forms on real hyper- 
bolic manifolds by Schuster |2^, Fried [Q, Juhl [pO[ . 



Proof: We employ Theorem |6.2| . The Casimir operator Q{X ) coincides with the form 

-1- 

2 
2 ' 2 



Laplacian A^ Thus A(A^aP)=^ = A'^ - ( "-i-2p )2_ rj.^^^ ^^^^^ ^f ^^le singularity at 
s G 2R U (-^^^^, ^^^^] is given by 



The differential d induces isomorphisms of eigenspaces corresponding to non-zero eigen- 
values of different Laplacians. Taking this into account we obtain the assertion about 
the spectral singularities. A similar argument works for the topological singularities at 
s < ~ "~2~^^ - The point s = ± ""2"^^ corresponds to harmonic forms. Here d vanishes. 
Hence the result for s = ^~^~'^p follows. At s = — "~2~^^ we also have the contribution of 
the O'th Betti number of the dual space. □ 

We now combine the results about the Selberg zeta function in order to discuss the 
Ruelle zeta function. Let g = k©a©nbean Iwasawa decomposition of g. Let a be the 
positive root of (g, a) which has the multiplicity n — 1. We have |a| = 1 and \p\ = ^^. 
By Cj. we denote the one-dimensional representation of A corresponding to the weight 
ra. As a representation of MA the Lie algebra n can be identified with R"~^ © Ci. We 
obtain A^n = aP (g) Cp, p < n/2 and A^n = o-""^"^ (g) Cp for p > n/2. For p < n/2 let 



{p}. By Proposition |7.2| we obtain 




Zr{Zj - II I ^ ._ „-i 



Zsiz + ^-p,aPW ''>" 



Zsiz-^+p,aP)^ 



Using Proposition ^T] we can describe the singularities of the Ruelle zeta function. We 
demonstrate the contribution of the spectrum of the form Laplacians. If Im{z) 7^ 0, then 
the order of the singularity of Zji{z) at the point z is 

n/2-1 , , -I 

Y: i-iy (ord^>=.{Zs{z' + -p,an- Zs{z' - +p),a^] 

p=0 '^ ^ 

p=0 ^ ^ 
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n/2-l 

= Y. {-lTdim{AljUJ = {-z^ -{n-\- 2p)z)uj, 5u = 0} 

p=0 

n/2-l 

- Y. {-'i-Y dim{ AIjU = {-z^ + (n - 1 - 2p)z)cu, buj = 0} 

p=0 
p=0 

Thus the eigenvalue A > ^"^ ~ ^^ of the Laplacian A^, restricted to the co-closed forms, 
gives a contribution at z = -B^l^ ± /(^ESj^T^. Here Re{z) = -^^^^. 



Finally we discuss the singularity at the point z = 0. We apply again Proposition ^A 
and obtain 

n/2— 1 / p n—p—1 

P=0 \j=0 j=0 

n/2-1 / p n 

= E E(-i)''&.(^)+ E (-iy&.(M) 

p=0 \i=0 j=p+l 

= |x(M). 

This reproves in the real hyperbolic case that the order of the singularity of Zfi{z) at 
z = is ^x{M). 

8.2 The Dirac operator on the real hyperbohc space 

In order to consider the Dirac operator we take G = Spin{n,l), K = Spin{n) and 
M = Spin{n — 1), n even. If F C G is a discrete co-compact subgroup without elliptic 
elements, then M = F\G/K is a closed spin manifold. Let 5*""^ be the spinor module 
of M. The spinor module S^ of K is reducible and splits S*" = A" © S*". We have 
r{S'^) = S"'~^, where r : -R(K) —>■ R(M.) is the restriction map. It is known that discrete 
series representations of G can not occur in L^(ifR"', Vi^S^l)) ( see Seifarth [^). Hence 



5*!^ are S"' ^-admissible. The square of the Dirac operator on X can be expressed in terms 
of the Casimir operator of G and the scalar curvature r of X using the Parthasarathy 



formula |p5|| : 



8 
Let Dl be the restrictions of D"^ to C°°(X, V{Sl)). Then D^ coincides with A^{Sl, 5""^) 
up to an additive constant. By the calculation in |^ we have in fact 

A\Sl, S^"'^) = Dl. 

In fact, for both operators the essential spectrum starts at and has constant multiplicity 
with respect to the principal series representations of G occurring in L^(ifR", V{S!^)). 
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Now we discuss the singularities of the Selberg zeta function associated to the M-type 
S"~^. We norniahze the metric of X = if R" such that is has constant sectional curvature 
-1. 

Corollary 8.2 The singularities of Zs{p, S"^^^) are 

• zeros at p = i\ of order dimE£,{X}, where A is an eigenvalue of D, 



singularities of order — x(M) 



h j ^ ')2"/2-iatp=-(f+j),j = 0,l,2,.... 



For the topological singularities on the negative real axis we employed the computation 
of the spectrum of the Dirac operator on the sphere 5" by Sulanke [^ . 



Note that the Selberg zeta function Zs{Pi 5*" ^) for even-dimensional hyperbolic spin 
manifolds M is completely determined by the spectrum of the Dirac operator of M. 

8.3 Differential forms on complex hyperbolic manifolds 

Let G := SU{n, 1), K := S{U{1) x U{n)) and M := U{n - 1)2 '^'^^'^ U{n - 1). Consider 
SU{n, 1) as the subgroup of matrices of GL{n + 1, C) with determinant one fixing the 
form IzqI"^ — \zi\'^ — . . . — \zn\'^. S{U{1) x U{n)) consists of matrices diag{q,A), A G U{n), 
q G f/(l) with q det{A) = 1 and M is the subgroup of K of matrices of the form (g, q, B) 
with B G U{n — 1) and q^det{B) = 1. The two-fold covering of U{n — 1) is given by 
{q,q,B)^B. 

Let ^V be the representation of M on C"'"^ given (g, q, B) \-^ q~^B. The complexifi- 
cation of ^V splits as ^V'^ = '^V"^''^ © Myo,i_ Tailing appropriate alternating powers we 
obtain the representations ^A^'^. 

Let u = J2^=i ^* /\ ^* £ M^i,i ]^g ^Yie Kahler "form". The orthogonal complement of 
^M^p-i,ij-i (^ M^p.g consists of the primitive {p, g)-forms and is denoted by A^^. The 
representations A^ are irreducible. Similarly one defines ^A^'^ and A^''. Let r : -R(K) — > 
R(M.) be the restriction map. 

Lemma 8.3 For p, q with p + q < n — 1 



p—l<s<p,q—l<r<q 



(compare Gaillard [|13|)- By convention let A^''' = {0} if p or g is negative. 
Lemma 8.4 For p, g G N such that p + q < n — 1 we have 

A^M^ = r(E(-ir^Ar''^''-). 

r,s>0 
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This Lemma is an easy consequence of Lemma ^.3| . It is known that discrete series 
representation of G on L^(if C", A*T*i7C") can only occur on the forms of middle degree. 
Thus for p + q < n — 1 the K-type given in Lemma |8.4| representing A^ is admissible. 

Let t C m be the standard Cartan algebra given by diagonal matrices of the form 
diag{q,q,Xi, . . . ,x„_i), q,Xi G «R, '2q + J2^=i ^i = 0. We can write weights as n+1-tuples 
of complex numbers such that the first two entries coincide and the total sum vanishes. 
The positive roots of M are {Eij}, 2 < i < j < n, where the only non-trivial entries of 
Eij are 1 at the z'th and —1 at in j'th place. The half-sum p^ of the positive roots is 
Pm = 1(0, 0, ra - 2, n - 4, . . . , 4 - ra, 2 - n). 

The weight of the z'th coordinate z^ of V^'^ is (—1/2, —1/2, 0, . . . , 0, 1, 0, . . . , 0), where 
1 is at the (2 + 2)'th entry. Analogously the weight of z' is (1/2, 1/2, 0, . . . , 0, -1, 0, . . . , 0). 
For p + q <n — 1 the highest weights of ^A^'*^ and A^^ coincide and are given by 



p— times q— times 

We compute the shift constants c(A^). We use the invariant scalar product on g given 
by the trace norm {X, Y) := ^trXY. The metric induced on t* is simply |(a;o, . . . , a;„)p = 
2Er=okiP- We obtain 

|Pmp- IPm + PA^H^ = {p + qf -2n{p + q). 

The algebra a can be chosen as the set of matrices 

diagd ^ J^ j , 0, . . . , ), r G R. 

n—l —times 

A linear form on a can be written in a compatible way as {n + l)-tuple (x, —x, 0, . . . , 0), 
x G C. Fixing a positive direction in a the short root of (g, a) is a = |(1, —1, 0, 0, . . . , 0). 
It has multiplicity 2n — 2 while the multiplicity of 2a is one. The half-sum p of the positive 
roots of (g, a) is |(2(n — l)a + 2a) = |(n, —n, 0, . . . , 0) and we have |pp = n^. 

Lemma 8.5 For p + q < n — 1 we have 

c{A^^) = ip + q-nY. 

It follows that 

A(A^^A;CIT = Ar-(r + s-r^)^ (28) 

where A^''' is the restriction of the p + g-form Laplacian to the primitive {p, g)-forms. 

Let M be a closed locally symmetric complex hyperbolic manifold. The choice of the 
trace norm on g induces a scale of the Riemannian metric of M such that the sectional 
curvatures are between —1 and —4. Let u denote the Kahler form of M and 6 be the 
adjoint of the deRham differential d. By hl'^{M) we denote the dimension of the primitive 
(p, g)-cohomology of M, i.e. 

K''{M) = dim{HP'\M)/ijHP-^'''-\M)) = dim kerAP'" 

Combining (El) with Lemma |8.4| and Theorem |6.2| we obtain 
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Proposition 8.6 The Selberg zeta function Zs{z, A^), p + q < n — 1, has the following 
singularities : 

• at z = ±tX 7^ 0, A G R or A G zR with |A| < n — p — q, of order 

dim{a G C°°(M, A^''T*M)|Aoa = (A^ + (p + g - nf)a, 6a = 0}, 

• at z = of order 

2dim{a G C°°(M, A^^T*M)\A,a = {p + q - nfa, 6a = 0}, 

• atz = n — q — pof order 

r,s 

• atz = q + p — nof order 

7^ n + I 

• at z = —X, R 9 A > 77, — (p + g) of order 

dim{a G C°°(PC", A^^T*PC")| Aoa = (A^ - (p + g - nf)a, 6a = 0}. 

We have employed the isomorphisms induced by d of the non-zero eigenspaces of the 
different Laplacians on the bundles corresponding to the K-types occurring in Lemma 



B.4. Note that if a is co-closed and primitive, then da is primitive, too. If a is primitive. 



then so is 6a (see Wells [^ 4.3.10.) 

We consider the Ruelle zeta function. The Lie algebra n splits as n = Hq, © n2a 
with respect to the action of MA. We can identify (n^)'^ = '^V^ ® Cq, and (n2Q,)'^ with 



C2a, where Cp is the one-dimensional representation of A with weight /5. We abbreviate 

1 we have 



Cpa = Cp. For A; < n — 1 we have 



A\ny = ''''A'®Ck®''''A^-'®Ck+i 



p+g=fc,fe— 1 r,s>0 
i2n—l—k/„\c I' \ k/„\c\* 



/^^n-l-k^^y ^ (A'=(n)^)* ® C2„ 



p+q=k,k—l r,s>0 



Let 



h '■= {{p,(l,r,s)\p,q,r,s eN,p + q = k or p + q = k — 1,0 < r < p,0 < s < q} 
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50 



By Proposition U^ we obtain the following representation of the Ruelle zeta function in 
terms of Selberg zeta functions: 



n-l 



'U(p,q,r,s)eh ^s{z + n-2k + p + q,A^ 



k=o \ll{p,q,r,s)eh ^s{z + 2A; - n - p - g, A^ 



s,q—r\ 



(-1)" 



s,q—r\ 



Using Proposition q^ one can describe the singularities of the Ruelle zeta function in 
terms of the spectrum of the form Laplace operators. In order to demonstrate the contri- 
bution of the differential form spectrum we consider the singularities at z for Im{z) ^ 
large enough. 

The singularity at z has the order 



E 

fc=0 



n~l 

= E 

fc=0 
n-l 

- E 

fc=0 
n-l 

= E 

k=0 
n-l 

- E 

fc=0 
n-l 

= E 

fc=0 
n-2 

- E 

fc=0 
n-l 

- E 

fc=0 
n-2 

+ E 

fc=0 



-1)^( ^ ord,,=,Zs{z' + n-2k + p + q,A 

(p,q,r,s)elk 

ord^,=^Zs{z' + 2k-n-p-q, A^'"''^'"')) 



p—s,q—r 

M 



-1)'= ^ dim{AP-'^'''~'a = {{p + q-nf-{z + n-2k + p + qf)a,6a = 0} 

(p,(j,r,s)ei'fc 

-1)'= J2 dim{AP-'''^-'a = {{p + q-nf -{z + 2k-n-p-qy)a,6a = 0} 

{p,q,r,s)elk 

-if J2 dim{A'''''a = {{p + q-nf-{z + n-2k + p + qf)a,Sa = 0} 

p+5=fc,fc — 1 



-1)'^ ^ dim{AP''^a = {{p + q-nf -{z + 2k-n-p-qY)a,Sa = 0} 

p+q=k,k—l 



-l)''dim{A''a = {{n - kf - {z + {n - kf))a, 5a = 0} 
-l)''dim{A''a = {{n ~ kf - {z + {n - k - lf))a, 5a = 0} 
-lfdim{A''a = {{n - kf - {z - {n - kf))a, 5a = 0} 
-lfdim{A''a = {{n - kf - {z - {n - k - lf))a, 5a = 0} 
Thus, an eigenvalue X > [n — kf of the fc-form Laplacians, k < n — 1, contributes to 



the singularity of the Ruelle zeta function at z = —e{n — k) ± J [n — kf — A with sign 
(— l)'^e G {—1, 1}. In particular, Re{z) = —e{n — k). \i k < n — 1 then there is also a 



contribution to the singularity at 2; = —e{n — A; — 1) ± J [n — kf — A with sign (— l)'''+^e. 
Here Re{z) = —e{n — k — 1) . Note that the pattern of the contribution of the k-iorm 
spectrum to the singularities of the Ruelle zeta function differs from the real hyperbolic 
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case. Note that Fried |T^ employs zeta functions associated to {p, g)-forms on complex 
hyperbolic manifolds in order to express the analytic 9-torsion. 

— 1/2 

8.4 The bundle Kj^j over complex hyperbolic manifolds 



We study the Selberg zeta function associated to a square root \^Km of the canonical 
bundle of a complex hyperbolic manifold. 



Let G, K, M as in Subsection |8^. Assume that n is odd and n > 1. The surface case 



n = 1 is contained in the Dirac operators case on real hyperbolic manifolds considered 



in Subsection |8]^. We consider the M-type k/2 being the one-dimensional representation 
{q,q,B) -^ g("+i)/2_ Lgt K/2 be the one-dimensional representation {q,A) — > g("'+i)/2. 
Then r{K/2) = k/2, r : -R(K) — > i?(M). Let M be a locally symmetric complex hy- 
perbolic manifold. The line bundle Vm{K/2) is a square root of the canonical bundle 
Km = A"^°'^T*M. It defines a spin structure and an associated Dirac operator over M. 
This Dirac operator is nothing else than the total Dolbeault operator D := d + d* on 
the spinor bundle Sm = Vm{K/2) ® {®^^oA^'PT*M). It is known that L^iHC, Shc-) 
does not contain discrete series representations of G (see Seifarth, |^). In particu- 
lar, L'^{HC'^,V{K/2)) does not contain discrete series representations and hence K/2 
is fc/2-admissible. The Dirac operator D^ splits into a direct sum of D^, p = 0, . . . ,n, 
with respect to the form degree. The operator D^ is responsible for the singularities of 
the Selberg zeta function associated to k/2. We use again the Parthasarathy formula 
D'^ = ^{Sm) + r/8 in order to compare D^ with A{K/2, k/2f. 

On g we again fix the invariant scalar product given by (X, Y) = ^tr{XY) inducing 
on M a metric with sectional curvatures between —1 and —4. The scalar curvature of M 
is then r = —4n{n + 1). 

We fix the Cartan algebra of g as in Subsection ^.3| and employ the notation for weights 
explained there. The weight of the representation k/2 is given by 

1 Ti — 1 Ti — 1 

/i=2(^-'^-'-l'- ••'-!)• 

We obtain |/ip = ^^^^ and < Pm, /^ >= 0. Using |pp = n"^ it follows c{k/2) = ^^^^ We 
obtain 

A\K/2,k/2) = Dl-^^^^. 



Corollary 8.7 The singularities of the Selberg zeta function Zs{p, k/2) are 

• zeros of order dimE^2{\} at ^ p E [— ^"^ ' , ^"^ ' ] U tH, with p^ = ^"~ ' 

• a zero of order 2dimE^2 { ^"~ ' } at p = 



zeros of order —2 ^^^-/ dimEij2 ^ {p^ — ^ ^ } at the points p < with p = 21 + 

2 



l> ^^ 
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In order to describe the topological singularities of the zeta function we used the compu- 
tation of the spectrum of D^q = ^*^ '^^ Vd{K/2) — > PC^, i.e. of the Dolbeault operator 
on the square root the canonical bundle of PC", found in Seifarth/Semmelmann [pl[] . 

8.5 One-forms on quaternionic hyperbolic manifolds 

In the case of quaternionic hyperbolic manifolds let G = Sp{l,n). It is the subgroup of 
Gl{n + 1, H) fixing the quaternionic scalar product lo'oP — lo'iP — • • • — lo'nP- Its maximal 
compact subgroup is K = 5*^(1) x Sp{n). Then X = ifH" = G/K is the quaternionic 
hyperbolic space. We consider only the case n > 2, since ra = 1 is contained in the 
hyperbolic case. On HH^ fix the metric which has sectional curvatures between —1 
and —4. Then p = 2n + 1 and the short root a of (g, a) has length one. Here a is 
defined by an Iwasawa decomposition ofg = k©a©nas usual. We consider K C G 
as the subset of matrices diag{q,A), q G 5*^(1), A G Sp{n) of G. Moreover, we let 
M = Sp{l) X Sp{n — 1). We consider an M-types occurring in the representation of M 
on n. This M-type is interesting since it contributes to the singularities of the Ruelle 
zeta function. Already this example shows a rather complex behavior. This complexity 
eventually prevents us from a complete understanding of the singularities of the Ruelle 
zeta function. 

Let A^ be the isotropy representation of K. Thus A^ is the representation of K on H" 
given by H" 9 a; ^ Axq, diag{q, A) e K. Then r(A^) = cr^ © a' © 1, r : R(K) -^ i?(M) 
being the restriction map. Here 1 is the trivial representation, a' is the 3-dimensional 
representation of M on the root space n2a corresponding to the long root and a^ is the 
representation of M on the root space Hq, corresponding to the short root. Identify Hq, 
with H""-*^ and n2a with R-*- C H = (H""^)-*- C H". Then the representation a^ is given 
by a; — ^ Bxq, x G H""-*^, diag{q, g, 5) G M and a' is given by 2; — > qzq, z G R"*". There is 
an analogous representation A' on R-*- of K given by z — >• qzq, z G R"*", diag{q,A) G K. 
Obviously, r(A') = a'. 

The bundle V{X^) is the bundle of one-forms on ifH". The bundle V^(A') can be 
viewed as a subbundle of A^T*ifH". The fibre of ^(A') is the space of Kahler forms 
distinguished by the quaternionic Kahler structure. 

Lemma 8.8 The representation A^ — A' — 1 is a^ -admissible. 

Proof: It is known that discrete series representations of G in L^(ifH", A^T*ifH") only 
occur on the harmonic forms in the middle degree. □ 

In the normalization of the metric with sectional curvatures in [—4, —1] the shift 
constant of a^ is c(cr^) = 4n^. Hence, A(l,cr^)^ = Aq — 4n^, where Aq is the function 
Laplacian, A{X^,a^)'^ = Ai — 4n^, where Ai is the one-form Laplacian and A{X',a^) = 
^2\v{\') — 4n^, where A2|y(A') is the restriction of the two-form Laplacian to V{X'). We 
have used the fact that the G-Casimir operator on differential forms coincides with the 
Laplacian. 



8 EXAMPLES 53 

We define the differential operator B : C^{HW,A^T*Hli") -* C°°{HW, V{X')) by 
Ba = irda, where vr : A^T*iJH" -^ Vi^') is the orthogonal projection. 

Let M be a closed locally symmetric quaternionic hyperbolic manifold. Then we have 
the induced bundle Vm{X') ^ M and B : C^{M, A^T*M) ^ C^{M, 14/ (A'))- 

Proposition 8.9 The singularities of the Selberg zeta function Zs{p,cr^) are 

• zeros of order 

dim{a G C°°(M, A^T*M)\Aia = (A^ + An'^)a, 6a = 0,Ba = 0} 
at p = tX, Xe (RU i{-2n, 2n)) \ i{2n - 4, 0, -2n + 4}, 

• a zero of order 

2dim{a G C°°{M, A^T*M)\Aia = (A^ + An^)a, 6a = 0,Ba = 0} 
at p = 0, 

• a singularity at p = ±{2n — 4) of order 

dim{ae C'^{M,A^T*M)\Aia = 16{n - l)a,6a = 0} 
-dim{uj G C°°{M, Vm{X'))\A2UJ = 16{n - l)uj}, 

• a pole of order bo{M) — bi{M) = 1 at p = 2n 

• a zero of order hi{M) - 6o(M) + ^^ = ^^ -I atp= -2n 

• poles of order 

2^!^dim{a G C~(PH", A^T*PW)\Aia = (A^ - An^)a, 6a = 0,Ba = 0} 
n + 1 

atX = {-2r2-4, -2n-6,...}. 

Lemma 8.10 ker B* C {to E C^{M, 1/m(A'))|A2CU = I6{n - l)iu} 

Proof: First we discuss the behaviour of B* on if H". Let H'^ '^ be the hyperfunction 
globalization of the principal series representation of G associated to a' and 2; G C = a*. 
Then there are unique Poisson transforms (Olbrich, ||23|1 ) 

P^'^, : ii"''" -^{ae C°"(/JH", AiT*ffH")|Aia = ((2n + 1)^ + 8 - z^)a} 

and 

P^i, : H''''' ~^{ae C^iHW", V{X'))\Aia = ((2n + 1)' + 8 - z^)a}. 
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We have 

B*P^:^, = {z + 2n- 3)P,Y,. 

For Re{z) > the Poisson transform P^, ^ is surjective. Hence all eigenforms of A2\v{y) 
arise as Poisson transforms. Moreover, P^, ^ is injective for Re{z) > 0, z ^ 2n — 3. 
Therefore, if a; is an eigenform of A2 and B*u! = 0, then A2UJ = 16{n — l)uj. In particular 

{uj e C~(i7H", V{X'))\6uj = duj = 0} = {0} (29) 

Note that C°°(M, \/m(A')) is the space of P-invariant sections of C°^{HU",V{X')). Any 
form in C°°(M, VAf(A')) can be decomposed into eigenforms of A2. The claim of the 
Lemma follows. □ 

Proof of the Proposition: We first discuss the spectral singularities at p G zR U 
{-2n,2n). The operator d : C°°(M) -^ C'^{M,A^T*M) induces an isomorphic em- 
bedding of the eigenspaces of ^4(1, o"^) into the corresponding eigenspaces of A{X^, cr^) for 
all eigenvalues A 7^ t2n. The kernel of d is the space of constant functions and corre- 
sponds to the eigenvalue t2n of ^4(1,0"^). The orthogonal complement of the image of d 
is characterized by (5a = 0. 

By Lemma |8.10| the operator B* induces an isomorphic embedding of the eigenspaces 
of A{X', cr^) into the corresponding eigenspaces of A{X^, a^) for all eigenvalues A 7^ t{2n—4) 
of A{X' , (T^). At A 7^ i{2n — 4) one has to subtract 

dim{uj G C°^{M, Vm{X'))\A2UJ = lQ{n - l)uj} 

by hand. Since im{B*) ± im{d) the assertion about the spectral singularities follows 
easily. 

The point p = 2n corresponds to harmonic forms. Here d fails to be injective and one 
has to subtract 1 = bolM). On Va/(A') there are no harmonic forms (see (ppj)). Thus the 
order of the singularity of the Selberg zeta function Zs{p, cr^) is 61 (M) — 1. Furthermore, 
combining Borel-Wallach [|] II.7.8 and VII.6.1 it follows that 61 (M) = 0. Thus the Selberg 
zeta function has a pole of first order at p = 2n. 

At p = —2n there is also a contribution from the spectrum of A(i(l,a^). Since there 
are no harmonic one and two forms on PH", we have md{2n, a^) = —1. The order of the 
singularity of Zs{p, cr^) a.t p = —2n follows. The argument for the remaining singularities 
on the negative real axis is similar to the one of the spectral singularities. □ 



9 Harmonic analysis on compact symmetric spaces 

In this section we collect some facts of representation-theoretic nature which we need to 
define the theta functions. Because these results are of independent interest we state 
them in greater generality than needed in the present paper. 
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9.1 The Cartan-Helgason theorem for vector bundles 

Let X := G/K be a Riemannian symmetric space of the non-compact type. Let P = 
MAN be the Langlands decomposition of a minimal parabohc subgroup, G = KAN 
and g = k © a © n the corresponding Iwasawa decompositions of G and its Lie algebra 
g, <l>"'"(g,a) be the positive root system corresponding to N and W = W^(g,a) be the 
Weyl group. Let p := | Z]ae<j>+(g,a) "^a<^) where m^ is the dimension of the root space 
corresponding to a. We assume that G is contained as a real form in its complexification 
G'^. We define G'^ to be the analytic subgroup of G'^ corresponding to g"^ := k © p^ C g'^, 
p'^ := «p, g = k © p being the Cartan decomposition of g, and Xd := G^/K the dual 
compact symmetric space. We choose a maximal abelian subalgebra t of m. Then 
h := f^ © a'^ is a Cartan subalgebra of g'^. We choose a positive root system <l>"'"(g'^, h) 
having the property that for a G <l>(g'^,h) a\a G '^"'"(g^ci) implies a G $"'"(g'^, h). Let 
5 := I J2a(^'S>+ (g<:,h) ^1 and set Pm '■= 5 — p. We choose a 1^-invariant scalar product (., .) 
on a and define the root vector H^ G a for a G $'''(g, a) by 

A(i7j:=|^ VAGa*. 
(a, a) 

Note that exp{2mHa) G M. 

Let 7 G K be fixed. Then we can decompose 7|m = ©o-eivit^ • ^l*^- ^^ ^^^ interested 
in the multipicities [tta : 7] for an irreducible representation tta with highest weight A G h* 
occurring in the decomposition of 

i:'(G'^XKV;)= [7rA:7]7rA. 

Theorem 9.1 Let [tta : 7] 7^ 0. Then 

L A|t equals the highest weight p^ of a representation a ofM. with [7 : fx] > [tta : 7]; 

^- ^^^ ^ ^"(^) + ^ ^'^ ^ "^^(g, a), where Eaicr) G {0, 1/2} is defined by 

^2me^(a) ._ a{exp{2mH^)) G {±1} ; 

3. ^^ > max|^g.j,+ (gc,h)|;3,,=«} ^ =: ^.(a) V« G <l>+(g, a) . 

Moreover, for (fx, 7) G M x K with [7 : o"] 7^ there exist constants Ca{o','~f) > $0(0") 
such that for A G a* with 

^^'"^ ee^ia) + N (30) 



and 



{a, a) 
(A, a 



>a(a,7) VaG<l'+(g,a) 



[a, a) 
and for A := \ + p„ Eh* , where p^ is the highest weight of a, the following equation holds 

[tta : 7] = [7 : a] . 
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Proof : Note that by holomorphic continuation tta extends to an irreducible representation 
of C^, hence of G, acting on the same vector space Kr- Let v\ be the highest weight vector 
of tta- Then f a is the unique highest weight vector for the action of M in the n-invariants 
of Vt, denoted by V^. This gives us the desired irreducible representation a of M. In fact, 
the Iwasawa decomposition implies that va is a cyclic vector for the action of K in V^. 
Therefore the mapping 

F : HorriKiV^, V^) ^ HomM{V„, V^) (31) 

defined by 

FiT):=Tot; ^:K^C, 

where K- and Vy are representation spaces for a and 7 respectively, is injective. This 
proves 1. 



In order to prove 2., we recall that (see Helgason |]T6|,Ch.VII,Thm.8.5.) 



K n exptSL = exp{2m ^ n^if^ | n^ G N} C M . (32) 

ae$+(g,a) 

All these elements are of order at most 2. Hence 

±va = a{exp{2mHa))vA = '!T{exp{2mHa))vA = e («.«) tiA . 

3. is a simple consequence of the $~'"(g'^, h)-dominance of A and the fact that for 
(3 e ^~^{g'^, h) also —OP is in <!>"'" (g'^, h). Here, 9 is the Cartan involution of g. 

We come to the second part of the theorem. Given a pair {a, A) G M x a* with 

\ '"'" > $a((T) Va e $+(g, a) we form the $"^(g'', h)-dominant element A := A + yU<j G h*. 
We claim that if A also satisfies the condition (|30|) , then A is integral. We have to 
show that for H = H^ + -fft G ^a © t with exp{H) = 1 also e'^^^^ = 1. Indeed, since 
exp{Ha) = exp{Ht)^^ G M, we obtain for the highest weight vector v^ G V^ 

e^'^^^v^ = e^(^«)e'^-(^*)f, = a{exp{H^))a{exp{Ht))v, = v, . 

Thus, A is the highest weight of a representaion (tta, K-) of G^ such that the irreducible 
representation of M on V^ has highest weight yUo-. This shows that this representation 
coincides with a on the connected component Mq of 1 G M. Using (|30|) and the fact that 

M = (K n exp ?a) ■ Mo ([g,Ch.IX,ex.A3) 

we see that this representation is given by a on the whole group M. We are done, if we 
can show that the map F defined in (|3T|) is surjective for A big enough. 
The dual map 

F* : Homy^iy^, K) -^ Hom^iy^, K) 

applied to t G Hom-M.{y^, Va) is given by 

F\t) = f 7T{k-^)iot-f{k) dk . 
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Indeed, for T G iJomK(Kr, V^) we have 

tr{ToF*{t) =tr{T f n{k-^)iot-f{k) dk) = tr{ f -f{k-^)T oiot-f{k) dk) =tr{F{T)ot) . 

In order to decide injectivity of F*, we consider for (o", A) G M x a*, (A, a) > Va G 
$"'"(g,a) the c-function 

c^((T,A) := P„ f_a{ny^^^f'^-f{K{n)) dnP„ G EndmY^ , 

where P^ is the projection onto the cr-isotypic component of V^, N := ^N and n = 
K{n)a{n)n{n) is decomposed according to the Iwasawa decomposition. There exist con- 
stants C'^{a, A) such that 

detcJa, A) ^ whenever f^ > C'Ja, 7) V« G $+(g, a) . (33) 

[a, a) 

This can be seen using the expression of detc^{(T, A) in terms of the F- function given for 
example in Wallach ||36|, Cor. 10.4.7. Alternatively one could argue that the integrand 
concentrates near the identity for A large. 

Let (., .) be a C^-invariant hermitian scalar product on Kr, v G V^,V\ G V^, t G 
Hom-M.(y^,Va). We compute 

{F*{t)v,vx) = {f n{k~')iot-f{k)vdk,vx) 

JK 



{_ a{n) '^^n^K^n) ^)n(m) '^iot'j{m)'j(K(n))vdn,vx) 



NM 

l_{a{n)^'^^i o t'y{K{n))v, TT{K{n))vx) dn 

N 

(i o tain)^''^^'^'^' 'y(K(n))v , Tx{n)vx) dn 

N 

= {iotc^{a^\ + p)v,vx) . 

In the last step we have used that with respect to (., .) 

7c{ny = 7c{e{n)-^) . 

We see that F* is injective iff c^(cr, A + p) is injective. This together with ( p3D implies the 
assertion. □ 

If 7 is trivial, then the c-function is explicitly known. In this case we have for all 
a G $"'"(g,a) Cq, = $Q, = £q, = 0. Inserting these data into the previous theorem we get 



the usual Cartan-Helgason theorem (see Helgason [jT^,Ch.V,Thm.4.1. 



Now we want to see more explicitly what Theorem ^TI] means for the spectral decom- 
position of L'^{G'^ Xk Vj) with respect of the action of the Casimir operator, if C^/K has 
rank one. 
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In our approach X = G/K comes with a fixed Riemannian metric. It induces a metric 
on a (and a*) considering a as a subspace of TexX- The root system $"''(g,a) is of the 
form $"'"(g, a) = {a} or <I>+(g, a) = {a/2, a}. We call a the long root. We identify 

a* = R, (a")* = C 

sending a to |a|. The metric on a provides a normalization of the y4(i(g'^)-invariant bilinear 
form (., .) on (g"^)* x (g'^)* (and g'^ x g'^) by 

(a, a) = |ap . 

Note that (., .)|gdxg'* is negative definite. Let Q^ be the corresponding Casimir element in 
the universal enveloping algebra lA{gf'). 

Now we fix the necessary bookkeeping for its action on L^(G'^ Xk V^)- 

Definition 9.2 Let a he the long root as before and set T := |a|. 
For a e M we define t{a) G {0, 1/2} hy 

e{a) = p/T + ea{(j) mod Z , 

the lattice L{a) C R = a* by 

L(a):=T(e(a) + Z) 

and the shift constant 

c((T) := |(5p - \fla + Pm\^ = IpI^ + |PmP - |P^ + Pr, '^ 

Finally, for A G (a'')* = C we set 

{X + fi„ + Pm, P) 

/3g$+(gc_h) 



-'m 



^'^-*- n (,,) 



Recall the definition of $a(cr) from Theorem OTl] and let 



$((t) := max{|a|$o((T) | a E $^(g, a)} + p . 

Consider for A G L{cr), A > $(cr) and A := \ — p + p^- the representation n\ of G^ with 
highest weight A. Then Weyl's dimension formula states that 

dim{Tr\) = P{\, a) . 

In addition, we have 

MQ,) = (|A + 6\' - \6\')Id = {X' - c{a))Id . 



Now, in our situation Theorem |9.1| reads as 
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Proposition 9.3 The spectrum ofVtd acting on L (G Xk V^^ is contained in 

U {A'-c(a)|AGL(a),A><l>(a)} . 

{o-eM| [7:o-]7^0} 

Moreover, any eigenspace By of Vtd splits into a direct sum of subspaces 

(o-,A)gQ^(i/) 



where 



Q,{u) := {{a, A) I [7 : a] ^ 0, A G L(a), A > ^a), X' - c{a) = u] 



and there exist constants C(cr, 7) > $(cr) such that 

dimE^^x = [7 : or]P{X, a) VA G L(a), A > C{a, 7) .□ 

9.2 The C^-index theorem 



Let us return to the situation at ttie beginning of Subsection p.l| . We assume in addition 
that rankiG'^) = rank(K.). Otherwise the index of any C^-homogeneous elliptic operator 
on Xd would vanish (see Bott 0). Note that the rank condition is satisfied by symmetric 
spaces of rank one of even dimension. Our goal is to realize any (irreducible) representation 
of C^ as the index of a homogeneous Dirac operator operator on Xd- That this is possible, 
even for general compact homgeneous spaces G/H satisfying the equal rank condition, 
was already shown by Bott (0) under the additional hypothesis that 7ri(G) has no 2- 
torsion. Instead of refering to that theorem, we prefer to include here an elementary 
proof resting only on the Weyl character formula and having the advantage that it gives 
explicitly the desired Dirac operator. 

First, we need some more root systems and Weyl groups. We choose a Cartan algebra 
h,t C k being also a Cartan algebra of g"^. Let H be the corresponding maximal torus. 
Let $^(g'^,hfc) be a system of positive roots for g*^ and $"'"(k'^,hfc) be the subsystem of 
positive roots of k. Note that ^{^'^{g'^, hk) \ <l'"'"(k'^, h^)) = n/2, where n is the dimension 
of Xd. We set 

Let Wg := W^($+(g'',hfc)), Wk := W^($+(k'', h^)) be the corresponding Weyl groups and 
set 

W' = {weWg\ ^^(k^hfc) c w($+(g^hfc))}. 

The following considerations and computations are completely analogous to the ones 
in Parthasarathy |^ for the noncompact case. Let S := S^ Q) S~ = 5'(p'^) be the Spinor 
modul of p"' and c : p"^ —>■ End{S) be the Clifford multiplication. The Spinor modul 5* 
is a 5'pm(p'^)-representation. Let s : Spin{p'^) —>■ GL{S) and p : Spin{p^) — > SO{p'^) be 
the canonical maps. Then 

s{a)c{X)s{a-^) = c{p{a)X) X G p^ ae Spin{n). (34) 
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The isotropy representation gives a honiomorphisni i : K — > SO{p'^). Let K be the con- 
nected component of 1 in p~^(i(K)) C Spinijp'^). We will also denote by s the restriction 
of s to K. 

Let A G ih.% be the highest weight of an irreducible representation tta of G'^. It is 
not difficult to see (compare [^) that for all w G W^ the functional w(A + pg) — p^ is 



dominant and integral with respect to K, hence it is the highest weight of an irreducible 
representation 7a,^ of K acting on a vector space Va,u)- Furthermore, if the non-trivial 
element oip~^{i{l)) is included in K, then it acts on 5* as well as on Va^^; by multiplication 
with —1. Indeed, this element is central in Spin{p'^), hence in K, and of the form exp{H) 
for some H Ehk. Therefore, we have 

7A,^(exp(i7)) = e('"(^+''«)-^^)(-f^) . Id = e("'^«-'"=)(^) ■ Id = -Id , 



since wpg — p^ is a weight of S. 
Thus, the representation 



s®-fA,w ■■ K^GL{S(^V^ 



A,ui J 



is well defined as a representation of K. We extend the Clifford multiplication to S<^Vaw 
by 

c:p'^-^End{S(g)VA^^), c:=c(g)l. 

We consider the homogeneous vector bundle -Ea.ui '■= G'^ Xk {S ® Va,«,) and define the 
differential operator Da,w, the Dirac operator associated to the Dirac bundle structure of 

EA,n>, by 

DA,^fig) := E ^|,=o5(X.)/(^ exp{tX,)) , (35) 

where {Xj}"^^ is an orthonormal basis of p"^, and we have identified 

r{EA,n.) = {fe C°°(G^^® Va,J I f{gk) = (s ® 7a,J(A;-^)/(^)} • (36) 

The grading S = S~^ (B S~ induces a corresponding grading Ea,w = E'^w ® -^a w The 
operator Da,w splits as Df^^ : T{Ea^^) -> r(Ej„,). By (|3|) we get 

Lemma 9.4 D^ are G'^-invariant differential operators. 

The G'^-index of Da,w is the element in the representation ring R{G'^) of G'^ given by 

ind^dD A,w ■= [kerDl^J - [kerDj^^J . 



Theorem 9.5 The G'^ -index of the homogeneous Dirac operator Da,w defined in (3t) 
equals 

{-lY'''det{w)[TiA] eR{G'^) . 
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Proof : Let ip G C°°(G'^) a C^-finite function. ip acts on T{E\^m) as a finite dimensional 
operator l^ via convolution. For / G r(i?Au;) in the identification (^) this action is given 

by 



= / '^{9x'^)f{x) dx 

= / il){gkx^^){s ® '^{^yj){k)f{x) dx (for any A; G K) 

ip{gkx^'^){s ® 7a,«;)(^) c^^ /(a^) c^a^ • (37) 



C JK 



We assume all Haar measures to be normalized having total mass 1. 

It is enough to show that the supertrace of l^ with respect to the grading of Ej^^^i is 
given by integration of ip against the character xa of tta with the appropriate sign. In 
fact, it is enough to show it for class functions ip- In view of (^) /^ is an integral operator 
with kernel given by 

l^{x,y) = / ip{xky'^){s ® -fA.w){k) dk . 

JK 

Thus, for class functions tp its supertrace can be obtained in the following way 

Tr{l^) =11 ip{xkx~^)tr{s ^ 'yA,w)ik) dk dx 
= / ip{k)tris®^!yy,){k) dk . 

Let us denote by xs± cind x-y the characters of S^ and 7a,w, respectively. They are 
uniquely defined as functions on K, but their product drops down to K. We introduce 
the Weyl denominators 



a{X)/2 _ g-a(X)/2 



AG.(expX) := \{ (e' 

AK(expX) := n (e"^""^^' - e-'^^^)/^^) , X G h, 

A„ := AgVAk • 
Now, using Weyl's integral and character formulae for K and G'^ and 

{Xs+ - X5-)|H = A„ (see [||]) , 
we can compute 

Tr{l^) = j i){k)tr{s®-fK^^){k)dk 

i'ik){xs+ - Xs-)ik)X'yik) dk 
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1 



^{h)\A^{h)\\xs+-Xs-){h)x,{h)dh 






1 f /LMA /LM2 V- det(s)e""'(^+^s)('"»('^)) 



/ V'WIAg.^I/^)!' E — dh 



iwiTyi L^m^o^m^ E E A .^-l.^ — dh 



|W^,| ^H 



/ ^W|Ao.(/.)r E ^ ^' ,,, dh 

ij{h)\A^,{h)W^{h) dh 






(-If/^rfetH l,^{g)xA{9)dg.a 



9.3 The restriction map r : R{K) -^ R{M) 

The goal of the present subsection is to discuss the surjectivity of the restriction map 

r : R{K) — > R{M) 

between the representation rings over Z of K and M, respectively. We retain all notations 
and assumptions from the beginning of Subsection |9.1| . We shall restrict our considerations 
to the case of rank one symmetric spaces of even dimension. Recall the definitions given 
after (|3^ ) of the covering group K and its spinor representation s. For the present case 
we have 

Proposition 9.6 The map r is surjective. 

Moreover, if 'y & ker r C -R(K), then there exists a representation r ofK., such that 
s <^ T is defined on K and 

7 = [s+ (g) r] - [s' (g)r]e R{K) . 

In particular, this implies that on the Z2- graded vector bundle G*^ Xk V^ there exists an 
odd homogeneous Dirac operator. 

Proof : The assertion concerning the kernel of r is proved in Miatello [^, Lemma 2.2. 
We prove the surjectivity case by case, showing that the fundamental representations of 
M lie in the image of r. 

The real case 

The two-dimensional case is clear. We may represent the real hyperbolic space X = 
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HR'^'',n> 2 either as X = Spin{l,2n)/Spin{2n) or as X = SOoil,2n)/SO{2n). Let us 
begin with the first case. Then 

K = Spin{2n) and M = Spin{2n — 1) . 

Let Xp := A^R^"" C be the exterior powers of the standard representation of S0{2n) 
and (jp := A^'R^"^^ (g) C the ones of S0{2n — 1), s"*" and s~ the half spin representations 
of Spin{2n) as before, and sq the spin representation of Spin{2n — 1). Then 

i?(K) = Z[Ai,...,A„_2,s+,s-] and i?(M) = Z[(Ti, . . . , a„_2, Sq] , 

and we have 

r(Ai) = (Ti + 1 ; r{Xp) = ap + (Jp_i, p = 2,...,n-2 ; r(s+) = r(s") = sq • 

Preimages are now easily to be found, namely 

ap = r(Ap-Ap_i + + {-1)^-^X1-1)), p=l,...,n-2 (38) 

So = r{s~^) = r(s^) . 

For the second case, i.e. 

K = S0{2n) and M = S0{2n - 1) , 

we remark that the representation ring of M is given by 

R{M) = Z[o-i, . . . , o-„_2, a„__i] , 

therefore all its generators arise as in (|38D as restrictions of elements of R{S0{2n)). 



The complex case 

The isometry group of the complex hyperbolic space X = HC"',n > 2 is PU{l,n) = 
SU{l,n)/Zn+i, whereas its maximal linear covering group is SU{l,n). Thus, for any 
divisor A; of n + 1 we may write X = G/K, where 

G = SUil, n)/Zk , K = SiUil) x U{n))/Zk . 

The corresponding group M is 

M = {{z,B)e f/(l) X U{n - 1) I z^det{B) = 1}/Zfc , 

where the embedding M ^^ K is given by 

[{z,B)]-^[{z,(^l °))]. 

We consider K as a ^^-fold covering of U{n) given by 

vr : K 9 [{w, A)] -^ vj-^A G U{n) . 
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Note that 7r(M) = U{n - 1). 

Let Xp := A^C" be the complex exterior powers of the standard representation of 
U{n) and Cp := A^'C"^^ the ones of U{n — 1). By means of vr, we consider them as 
representations of K and M, respectively. Then 

i^(K) = Z[Al,...,A„_l,u.^^i;-^] and i?(M) = Z[ai, . . . , a„_2, /', ^"1 , 

where w denotes the one dimensional representation {w, A) — * w, and z is given analo- 
gously by [z, B) -^ z. The restriction map looks as follows 



2,...,n-2 



r{w^^) 




r{\i) 


= ^1 + 1 , 


r{K) 


= (Tp + 0-p_i, p 


r(A„_i) 


= ^-("-^^^ + a„_2 



Hence, 



a„ 



riXp - \p_, + + (-ir-^(Ai - 1)) , p = 1, . . . , n - 2. 



The quaternionic case 

We may represent the quaternionic hyperbolic space X = ifH",n > 2 either as X = 
Sp{l,n)/Sp{l) X Spin) or as X = {Sp(l,n) /7i2) / Sp{l) ■ Spin). Let us begin with the 
first case. Then 

K = Spil) X Spin) and M = Spil) x Spin - 1) , 

where the embedding 5*^(1) x Spin — 1) "^-^ Spil) x Spin) is given by 

Spil) X Spin -l)3iq,B)^iq,h ° W Spil) x Spin) . 

Let Xp := A^C^" be the complex exterior powers of the standard representation of Spin) 
on H" = C^" and ap := A^C"-^ the ones of Spil) x Spin - 1). Note that for p > 1 they 
are not irreducible, nevertheless they generate the representation ring of Spin). Extend 
them trivially to Spil) x Spin) and Spil) x Spin — 1), respectively. Then 

i?(K) = Z[p,Ai,...,A„] and /2(M) = Z[g, ai, . . . , a„_i] , 

where p (resp. q) denotes the standard representation of 5*^(1) trivially extended to 
Spil) X Spin) (resp. ^^(l) x Spin — 1)). The restriction map looks as follows 



2,...,n 



rip) 


= q , 




riXi) 


= (^1 + q , 




riK) 


= ap + qap^i, 


p 


r(A„) 


= qan-i + (Tn- 


-2 ■ 
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Preimages of the generators can now inductively be determined by 

q = r{p) , 
ai = r(Ai-p) , 

; (39) 

ap = r(Ap) - gcrp_i . 

In the second case, i.e. 

K' = Sp{l) ■ Sp{n) ^ Sp{l) xz, Sp{n) and M' ^ Sp{l) Xz, Sp{n - 1) , 

we see that the representation ring of K' is given as the subring of -R(K) generated by 

{p"^, \i,p\j, \j\k I i even, j, k odd, 1 < i,j,k < n} . 

Analogously, the representation ring of M' is given as the subring of -R(M) generated by 

{g^, (Tj, qaj, a^aj \ i even, j, k odd, 1 < i, j, /c < n — 1} . (40) 

Call an element in K (M) even, if (—1, —Id) acts trivially, and odd otherwise. Then we 
have 



Thus 



K' 


= {7 G K 7 even} , 


M' 


= {(7 G M 0" even} . 


i?(K') = 


{ Y^ a^7 1 ^7 ^ Z} 




{7eK 1 7 even} 


R{y\!) = 


^ a^a a„ eZ} . 




{o-eM 1 a even} 



From (^) we see that any even (odd) generator of i?(M) can be expressed as the restric- 
tion of a weighted sum of even (odd) elements in K. We conclude that all generators 
in (^Op arise as restrictions of a weighted sum of even elements in K, hence belong to 
r{R{K')). 

The exceptional case 
The unique presentation of the hyperbolic Cayley plane X = HCa is 

X = F^^ySpin{9) . 

Then 

K = Spin{9) and M = Spin{7) , 

where Spin{7) is the stabilizer of a non-zero element in the spinor modul Sg of Spin{9) 
(which is isomorphic to the isotropy representation on Tej^HCa^). Let Ap := A^R^ C 
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be the exterior powers of the standard representation of 5*0(9) and ap := A^R^ (8> C the 
ones of 5*0(7), sg and sj the spin representations of Spin{9) and Spin{7), respectively. 
Then 

i?(K) = Z[Ai, A2, A3, sg] and i?(M) = Z[a,, a^, S7] , 

and one can show that 

r(Ai) = S7 + 1 , r(A2) = 0-2 + ai + S7 , r(s9) = sy + ai + I . 

Preimages are now easily to be found, namely 

0-1 = r(s9 - Ai) , 
0-2 = r(A2 - Sg + 1) , 
S7 = r(Ai - 1) . D 
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